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Abstract. We study the geometry of the set of closed extensions of index of 
an elliptic differential cone operator and its model operator in connection with 
the spectra of the extensions, and give a necessary and sufficient condition for 
the existence of rays of minimal growth for such operators. 



1. Introduction 

The purpose of this paper is to study the spectra and resolvents of the closed 
extensions of an elliptic differential cone operator A on a compact manifold M 
with boundary, and of its model operator A A . It is well known that the closed 
extensions of A are in one to one correspondence with the subspaces of a finite 
dimensional space, ^max/^min? the spaces 2) max and X^ m j n being certain subpaces 
determined by A of an L 2 space on M, cf. Lesch 5 . It is thus natural to view 
the extensions as corresponding to points in the various Grassmannians associated 
with T> max /T> m j n . Extending this, we develop a viewpoint in which issues pertaining 
spectra and resolvents, both for the closed extensions of A and of A A , are expressed 
and examined in (finite-dimensional) geometric terms. 

Cone differential operators are generalizations of the operators that arise when 
standard differential operators are written using polar coordinates. Their study is 
therefore of interest in the context of manifolds with conical singularities, both in 
themselves and as guiding examples in a general theory of analysis of differential 
operators on manifolds with other kinds of singularities, cf. Schulze |12|. 

Our motivation for undertaking this study comes from the desirability of exe- 
cuting Seeley's program m the case of elliptic cone operators. This requires a 
detailed understanding of the resolvent in terms of the symbol of A and the domain 
of the extension. From the pseudodifferential point of view, the symbol of A is a 
pair consisting of A A and its 6-symbol, or more invariantly, its cone-symbol c o{A) 
as defined in Scction|21 As in the standard theory of elliptic operators on a manifold 
without boundary, the statement that a given sector A C C is a sector of minimal 
growth for c w(A) is domain-insensitive. The operator A A , however, is a differential 
operator, so the analogous statement for A A requires that a domain be specified. 
In Section^lwe shall construct a natural bijection from the set of domains of closed 
extensions of A to that of A A , and in [3] we use pseudodifferential techniques to 
show that if 2? A is the domain of A A associated with the domain V of A, and if 
A is a sector of minimal growth for c <n(A) and for A^ with domain £> A , then it is 
also a sector of minimal growth for A with domain T>. This of course brings up 
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the question of how to determine whether a given sector, or even a ray, is a sector 
of minimal growth for with domain 2? A - In connection with this we give, in 
Theorem 18.71 a necessary and sufficient condition for A to be a sector of minimal 
growth for A A with domain D A . The condition (|8.8() of Theorem 18. 71 is in principle 
verifiable. 

Resolvents for cone-elliptic operators written as pseudodifferential operators have 
been constructed by other authors in special cases, e.g. Bruning-Seeley yQ, Mooers 
[T0| , Gil [2] , and Schrohe-Seiler ^T] , the last mentioned article being the one closest 
to our own aims in [3]. Also of interest is Loya [Sj in the context of 6-operators. 
Our goal, here and in [3], is to study the problem with minimal assumptions. 

A description of the paper follows. 

We shall be working with a fixed elliptic cone operator A acting on sections 
of a Hermitian vector bundle E over a manifold M; the latter is assumed to be 
compact of dimension n with nonempty boundary. The definition of cone operators 
is recalled in Section |3 where we also recall the definitions of the spaces on which 
cone operators act. In this section we introduce certain strongly continuous one- 
parameter groups of isometries k b , one associated with M and one with the interior 
pointing part of the normal bundle of dM in M (where lives). These actions 
generally play an important role in the analysis of degenerate elliptic operators, see 
Schulze 52] > and they do so here as well. 

The c-cotangent bundle, C T*M, is defined in Scction|31 Its definition is analogous 
to that of the 6-tangent bundle of Melrose [7| |Sj • It is a vector bundle over M 
which is canonically isomorphic to T* M over the interior of M. Cone operators 
have invariantly defined symbols, c <a(A), defined on C T*M . We also recall in this 
section the definition of A A , and discuss some properties inherited by A A from A. 
We also briefly recall the definition of the conormal symbol. 

In Section0|we first recall known facts about the closed extensions of cone-elliptic 
operators on compact manifolds, such as M, and sketch proofs of analogous results 
for the operator A A . Proofs are needed since A A , though elliptic in the proper 
sense, is not a Fredholm operator on the spaces naturally associated with it. For A, 
as is well known, there is a minimal closed extension with domain X> m in, and there 
is a maximal extension with domain £> max . Likewise, for A A there is the domain 
of the minimal extension, Z?A,min, and the maximal domain Z?A,max- In both cases, 
the minimal domain has finite codimension in the maximal domain (in fact the 
same codimension). The set of domains of closed extensions can be viewed as a 
Grassmannian variety, and there is a natural map 0, cf. Q4.221 . one can use to pass 
from one variety to the other. This is most relevant in indeed, the meaning of 
the condition that c a(A) admits a ray of minimal growth is clear, but to express 
the analogous condition for A A requires the specification of a domain for A A . This 
domain is the one associated by O with the given domain for A. 

The analysis of the spectrum of a given closed extension of A is taken up in 
Sectional It is natural to classify the set of extensions of A by the index. The ones 
with index being the only relevant in the problem of studying the spectrum, we 
let & be the set of domains T> such that ind Ad = 0; here and elsewhere Ax> means 
A with domain T>. The simple condition that both numbers d" — — ind Ap min and 
d! = ind ^4x? max be nonnegative is necessary and sufficient for to be nonempty, 
see Lemma 15.11 and if this is the case, then 25 can be viewed as a (complex) 
Grassmannian variety (based on 2? ma x/^min)- An at first surprising fact is that 
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if dim 25 > 0, then for every A G C there is V £ © such that A 6 spec Ad, see 
Proposition 15.71 
Letting 

bg-specA = P| spec Ad, bg-res A = C\bg-spec A, 
r>ee 

we get 

spec A-d = bg-spec A U (spec Ap n bg-res A), 

a disjoint union. It is the part of spec Ad in bg-res A that is most amenable to 
study. For A G bg-res A, the dimension of JC\ = ker(Ap max — A) is constant, equal 
to d', and 

A G res A© <=^ A G bg-res A and JC\ n V = 0, 
cf. Lemma lh. 101 by the same lemma, if JC\ R T> = then P max = ^Ca ffi P- Let then 
7r KA,i' be the projection on /C> according to this decomposition. 

If A £ bg-res A, then Ax> min — A is injective and Ax> max — A is surjective (this 
property characterizes bg-res A). For such A let -B max (A) be the right inverse of 
Ax> max — A whose range is orthogonal to K,\ with respect to the inner product 

(U,V) A = {Au,Av) x -m/2 L 2 + ( U ,v) x - m /2 L 2, 

and let -B m in(A) be the left inverse of Ap miii — A with kernel the orthogonal of 
rg(Ax> min — A) in x~ m / 2 L 2 b (M;E). Then, if A £ resA v , one has the formula 

Bp{\) = B max (X) -(I- B min {X)(A - X))Tr K ^ v B max {X) 

for the resolvent Bp(\) — {Ad — A) -1 of Ap, cf. I|5.19|l . This formula is evident 
if one notes that the factor in front of t^k^.v is the identity on IC\. In principle 
both -B m in(A) and -B m ax(A) can be written as pseudodifferential operators, a purely 
analytic problem, so inverting Ap — A is reduced to an algebraic problem, indeed, 
a problem in a finite dimensional space, as follows. 

Let £ max be the orthogonal of Pmin m Pma X with respect to the inner product 
defined above; this is a finite dimensional space. Let 7r max : P ma x — > P max be the 
orthogonal projection on £ max . Both / — -B m i n (A) (A — A) and -kk. x _p vanish on P m i n , 
so 

B-p{\) = -Bmax(A) - (l - B min (X)(A - A))7T max lltc^^p 7T max B max ( A) . 

On the other hand, 

A G res •<=>• A g bg-res A and ir max lC\ H 7r max P = 0, 

and for such A, S max = 7r max /C A ©7r max P, cf. LemmaEM The map 7r max n Kx ,p\ £ ^ 
is just the projection on ir maK IC\ according to this decomposition of £ max , cf. 
Lemma 15.211 

Organizing the information in terms of Grassmannians turns out to be quite 
useful. The set © can be viewed as the Grassmannian Gr^" (£ max ) of ^''-dimensional 
subspaces of £ max , and the spaces K,\ (which are the fibers of a holomorphic vector 
bundle over bg-res A) give a holomorphic map A i— > 7r max /C,\ G Grd'(£ max ). The 
condition that A G bg-res A n spec Ap is that TT max ICx belongs to the set 

QJd = {V G Gr d ,(S max ) : V n 7r max (P) ^ 0}. 

This is a complex analytic variety in Gr<j'(£ m ax) of codimension 1. The condition 
that for some nonzero Ao G bg-res A, the ray {rAo : r > R} contains no point of 
spec Ad is that the curve in Gr^/ (£ max ) given by r h vr max /C r A has no point in 
23d when r > R. And if V G Gr<i'(£ max )\93x>, then the norm of the projection on 
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V using S m ax = V © 7r max I? can be estimated in simple terms. This can be useful 
for estimating the norm of the resolvent of Ad near a point in spec Ad D bg-res A 

In Section we discuss some aspects of symmetric cone operators from the 
geometric perspective developed in Section [SJ Among other things we show that 
for such operators, the set of domains of selfadjoint extensions is a real-analytic 
submanifold of ©, and that if dim® > 0, then for every real A there is a selfadjoint 
extension of A with A in its spectrum. This is so even if the operator with minimal 
domain is bounded below (or above). A more detailed study of geometric aspects 
of the spectrum of selfadjoint extensions will be taken up elsewhere. 

In Section [7] we analyze A A , also from the perspective of Section [5] While A A 
is not a Frcdholm operator, the fact that it is homogeneous under the action of 
the one-parameter group n g permits a rather complete analysis of the operator, its 
background spectrum and the resolvents of the various extensions with index 0. 
Theorem 18.71 gives a necessary and sufficient condition for a given extension of A^ 
to admit a sector of minimal growth. 

We finish the paper proving Theorem 19.41 an analogue of Theorem 18.71 giving a 
necessary and sufficient condition for an extension of A to admit a sector of minimal 
growth. While the proofs of these theorems are quite similar, some assumptions in 
Theorem 19.41 are automatically satisfied in the case of Theorem 18. 71 

Most of the nonstandard notation used in this paper, and not mentioned in this 
introduction, is presented in Sections 0] and [SJ In general, objects associated with 
A A have the symbol A as part of the notation. For example, £ A jnax is the orthogonal 
of 2?A,min in 2?A,maxj and 7r A , max is the corresponding orthogonal projection. All 
the other projections will usually indicate the space on which they map: If H — 
E © F, then tte.f '■ H — > H will denote the projection on E according to this 
decomposition, and tte is the orthogonal projection on E. 



2. Definitions and conventions 

Throughout the paper M is a compact n-manifold with boundary, m is a smooth 
b- measure, E — ► M is a Hermitian vector bundle, and V a Hermitian connection 
on E. The boundary of M will be denoted by Y. By x we shall mean a smooth 
defining function of Y, positive in the interior M of M. This function will be fixed 
shortly so as to have certain properties that simplify the calculations. 

The 6-tangent bundle of Melrose, TM, is the vector bundle over M whose space 
of sections is 

C^ n (M; TM) = {Ie C°°(M, TM) : X is tangent to dM}, (2.1) 

see The space C^ n (M; CTM) is a Lie algebra over C under the usual Lie 

bracket, and the collection of elements of order < m in its enveloping algebra is the 
space Diff™(Af) of totally characteristic differential operators of order < to. If E — > 
M is a complex vector bundle and Diff m (M; E) is the space of differential operators 
on C°° (M; E) of order to, then Diff™(M;_E) denotes the subspace consisting of 
totally characteristic differential operators on C°° (M; E) of order m, cf. Melrose 

The elements of x m Diff™(M; E), that is, differential operators of the form 
A = x~ m P with P £ Diff™(M; E), are the cone operators of order m. 
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The Hilbert space L 2 (M; E) is the L 2 space of sections of E with respect to the 
Hermitian form on E and the density m. Thus the inner product is 

(u,v) L 2= J {u,v) E m if u, v G Ll(M;E). 

For non- negative integers s the Sobolev spaces H b (M; E) are defined as 

H b s (M; E) = {ue L 2 b (M; E) : Pu G L 2 b (M; E) VP G Diffg(M; E)}. 

The Hilbert space structure is defined using the vector fields in C^ n (M; TM) with 
the aid of the connection on E and a partition of unity. The spaces H b (M; E) for 
general s£K are defined by interpolation and duality, and we set 

H£°(M;E) = f]H s b (M;E), H b °°(M; E) =[J H b (M; E). 

s s 

The weighted spaces 

x^H§(M; E) = {x^u : u G H§(M; E)} 

are Hilbert spaces with the inner product for which H b (M;E) 3 u ^ x^u G 
x fJ -H§(M; E) is an isometry. In the case of s = one has 

x»H%(M;E) = x>*Ll(M;E) = L 2 (M,x- 2ll m;E), 

and the Sobolev spaces based on L 2 (M, x~ 2>1 m; E) and DifF^(M; E) are isomorphic 
to x^H b (M; E). The topological structure of these spaces is independent of the 
particular ^-density on M, Hermitian structure and connection of E, and defining 
function x. 

To simplify a number of computations and constructions it is convenient to 
introduce additional structure. Let 7r : NY — > Y be the normal bundle of Y in M, 
NY = TyM/TY. Let x : M -> M be any defining function for Y, positive in M. 
Since dx vanishes on TY, dx defines a function x A — dx : NY — > M. Define 

Y A = {v G NY : x A v > 0}, 

and let ir + : Y A — > Y be the restriction of ir. 

Let xd x denote the canonical section of b TM along Y. 

Lemma 2.2. Let my = xd x \m be the contraction of m by xd x along Y; my is a 
smooth positive density on Y. There is a tubular neighborhood map 

^ :V CY A C M (2.3) 

and a defining function x for Y in M such that 

$*m = — ® 7r* my in V. (2.4) 

x 

Proof. Pick some smooth but otherwise arbitrary tubular neighborhood map $ 
and a defining function x. Trivialize N+Y as [0, oo) x Y by choosing some smooth 
vector field d x in M along Y such that d x x — 1. Trivialized in this manner, 
i A : [0, oo) x Y — > [0, oo) is the canonical projection. The 6-density (X>7r^my is 
smooth, positive, and globally defined on Y A . Therefore, near x A = 0, 

,dx A _ „ 
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with some smooth function /. From the fact that $ is a tubular neighborhood map 
it follows that / = 1 when Xa = 0. There is g smooth, defined near Xa = 0, and 
equal to 1 at a; A = 0, such that if 

f(xa,v) = (xAg(xA,y),y), 

then 

F (f^A ® 7r+my) = -r^ ® Tr* + m Y ■ 

Xa Xa 



9 l-f(%A9,y) 



Indeed, this holds if g solves 

d ^ g = f(xA9,y) xa ■ 

Since /(0,y) = 1, There is a smooth solution with initial condition g(0,y) = 1. 
Define $ = $ o F. Then $ is a tubular neighborhood map satisfying 12.411 . Let 
a; be a smooth function on M, positive in M, that agrees with xa ° 3> near Y . 
Then $ and x are as required. □ 

We fix a tubular neighborhood map (|2.3|1 and defining function x for Y such 
that l|2.4|l holds, and take 

m A = — - <8> 7r^rriF (2.5) 

X/\ 

as density on Y A . We also fix x A as defining function for Y in N + Y. Both [/ and 
V contain Y. 

Let X A = d XA be the canonical vertical vector field. Fix a smooth real vector 
field X on M which coincides with d&(X A ) near Y. Shrinking V and U we assume 
that this holds in U. 

Definition 2.6. An operator P 6 Di&™(M; E) is said to have coefficients inde- 
pendent of x near Y if [P, V^x] = near Y, 

The operators on M we are concerned with need not have coefficients indepen- 
dent of x. They appear, however, in the form of Taylor coefficients. Namely, if 
P S Diff™(M; E), then for any N there are operators P k , P N £ Diff™(M; E) such 
that 

N-l 

p=J2 p * xk + p * xN ( 2J ) 

k=0 

where each Pk has coefficients independent of x near Y. The operators Pk are 
uniquely determined near Y by P and our choices of connection on E, defining 
function x, and vector field X. These Taylor expansions will be used in the course 
of the construction of the map 9 in Theorem 14.121 

If P has coefficients independent of x near Y then so does its formal adjoint P* 
in L\{M\E). This follows immediately from 

{V xX u,v) L 2 {M . E) = -{u,V xX v) Ll(M . E) , u,veC™(U;E). (2.8) 

To see that this formula holds we note that 

xX(u, v) E = (V xX u, v) E + (u, V x xv)e 

because the connection is Hermitian. Near Y, the Lie derivative C x xvn vanishes 
because of ()2.4J1 and the choice of X. So if u and v are supported in U and 
h = (u,v)e, then xXhm = C x xhm = d(hxX\m). Therefore, by Stokes' theorem, 
/ xX{u,v) E m = if u, v G C^{U;E). This gives (|2~31) . 
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Let E A — » Y A be the vector bundle tt+(E\y) and give it the canonical Hermitian 
metric and connection. An operator P G Diff™(Y" A ; E A ) is said to have coefficients 
independent of x A if it commutes with Va; A x A - The spaces 

x^H§(Y A ;E A ) 

are defined in a manner completely analogous to those associated with M, using 
operators with coefficients independent of x A ; for nonnegative integers s they may 
be defined using smooth vector fields in b TY A that commute with x A X A . Since 
Y A is non-compact, x^L 2 (Y A : E A ) literally means the L 2 -space corresponding to 
the measure x A 2M m A . 

Using the tubular neighborhood map $, define 

:E A \ V ^E\ LI 

as follows: For -q — (p, r}') G E A with p G V and rj G E n+ ( p - j , let &*rj G be the 

element obtained by parallel transport of rj' along the curve t 1— ► £ G [0, 1]. 

The map $* is a smooth vector bundle isomorphism covering <I>, an isometry because 
V is Hermitian. For this reason, and because of 12. 4|) . the induced map 

^ : x~ A m/2 Ll(V;E A \ v ) ^ x- m / 2 L 2 b (U;E\u) (2.9) 

is an isometry. 

Let Xt be the one parameter group of diffeomorphisms of M generated by xX. 
If u is a section of E, let (k 8 u)(p) G E p be the result of parallel transport of 
u(x\o ge p) G E xlossP along the curve 

[0,1] 3 s 1 ^ X(i- s )io ge (p) 6 M. 

There is a unique smooth positive function f g : M — > R with the property that 

/ e 2 x m m = Xl *o ge (^ m m). 

Definition 2.10. Let K g act on C^{M;E) f e Kg. Denote also by n g the 

analogously defined family of maps on Cq°(Y a ; E A ) obtained using m A and X/\d XA . 

The context will indicate whether an instance of k b means the operator on sec- 
tions of E over M or sections of E A over Y A . In the case of Y A , the function f g is 
g m l 2 . Because of the following lemma, the function f g , in the case of M, is equal 
to g m / 2 near Y. 

Lemma 2.11. Let u G C^°(V; E A \v)- Then K g <!>*u = $*K e u for all g > 1 - e for 

some e > depending on u. 

This follows from the definitions of and n g , using that near Y, <&*m = m A , 
x A = x o and $*9 Xa = X. The number £ serves only to ensure that the support 
of K e u is contained in V . 

Q 

Lemma 2.12. The family g h-> k B) initially defined on C^°(M;E), extends to 
x~ m f 2 L 2 (M;E) as a strongly continuous one-parameter group of isometries. 

o 

Proof. Let h denote the Hermitian metric on E. If u, v G C§°(M; E), then 

h(n g u, K e v)x m m = h(f g K g u, f g K l g v)x m m 

= h( Kg u, K\v)f e x m vn. = xio Sg {h{u,v)x m m) 
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so K e extends to x m l 2 L\(M\ E) as an isometry. Next we note that 

Jq'b = fe'Xiogg'fg- 

Indeed, 

= XlgAfgX m m) = (Xlgg<f 2 g)f 2 e >x m ™- 

Thus 

K g'g = fg'g K g'g = fg'(X\ogg'fg) K g' K g = fg' K g'fg K g = K g' K g- 
That g i — ► K e u is continuous follows from the fact that this holds when u belongs 
to the dense subspace C^°(M;E) of x~ m/2 L 2 (M; E) and the continuity of each 

Kg. □ 

We end the section with a brief comment on what we mean by the Mellin trans- 
form of an element of x _m / 2 L 2 (M; E). Fix uj G Cq°(— 1, 1) real valued, nonnegative 
and such that u> = 1 in a neighborhood of 0. Also fix a Hcrmitian connection V on 

° o 

_E. The Mellin transform of an clement u G C^°(M; E) is defined to be the entire 
function it : C — > C°°(Y; E\ Y ) such that for any v G C°°(Y; E\ Y ) 

{x-™uju,iTyv) L 2 {M . E) = {u{a),v) L 2 (Y . EW) . 

By tt y v we mean the section of E over /7 obtained by parallel transport of v along 
the fibers of tty- As is well known, the Mellin transform extends to the spaces 
x^Ll(M\E) in such a way that if u G x^L\(M\E) then u(a) is holomorphic in 
{3ct > — ^} and in L 2 ({3er = — ^} x Y) with respect to da ® my. 

The density m, the map $, the function x and the Hermitian connection arc 
fixed throughout the paper. For the sake of some notational simplification we 
will henceforth write x, m, and E instead of x A , m A , and E A . Fixing a defining 
function x for Y in M, as we have done, is equivalent to fixing a trivialization of 
F A , a diffeomorphism F A — > [0, oo) x Y. 

3. The symbols of a cone operator 

Let E, F — * M be complex vector bundles over M . An operator 

A G x- m DiffJ,"(Af;i;, J F 1 ) 

is called c-elliptic if P — x m A is 6-elliptic, which means that its 6-symbol, 

b <a(x m A) G C°°( b T*A/f\0;Hom(V*£;, b n*F)) 

(cf. Melrose, op. cit.), is invertible. Here V : b T*M\0 — > M is the projection 
map. This definition depends in a mild way on the choice of defining function: if x 
is another defining function for dM , then 

h a{x m A) = (x/x) m b «j(x m A). (3.1) 

Alternatively, consider the following construction of the c-cotangent bundle of 
M, C T*M, motivated by Melrose's definition of b TM, and definition of an invariant 
replacement of the 6-symbol. Let t : dM — > M be the inclusion map and define 

C™{M-T*M) = {q G C°°(M,T*M) : l*t] = 0}, 

the space of smooth 1-forms on M which are, over dM, sections of the conormal 
bundle of dM in M. Just as with the 6-tangent bundle, there is the c-cotangent 
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bundle, C T*M, whose space of smooth sections is C^(M; T*M), and a homomor- 
phism 

c ev : C T*M -> T*M 

which is an isomorphism over the interior. The fiber over p is 

C T;M = C™(M;T*M)/(1 P (M) ■ C™(M;T*M)) 

where T p (M) is the ideal in C°°(M) of functions vanishing at p, and the homomor- 
phism c ev is the one induced by 

C™(M;T*M)3r ] »r ] (p)eT;M. 

Since the latter map has 2 P (M) ■ C^(M;T*M) in its kernel, it induces a map 
c ev p : C T*M -> T*M. Let C TM be the dual bundle and let c tt : C T*M -> M be 
the projection map. 

At this point it is convenient to recall that the 6-tangent bundle of M is defined 
in a completely analogous manner using C t °^ n (M; TM), cf. 1)2.1(1 . so that 

%M = q~ (M;TM)/(1 P (M) ■ C£ n {M;TM)). 

Thus we have a map b ev : b TM -» TM. 

Now let A G x _m Diff™ (M;i?, F). Since A is a differential operator in the 
interior of M, it has a principal symbol there, given by the standard formula 

«i(A)(0(Hp)) = I™ T- m e-" f{p) A{e tTf (j)){p) 

T — >00 

with / a real- valued smooth function such that df(p) = £ and with cj> a smooth 
section of E. Suppose now that / is defined in a neighborhood of a point po € dM 
and vanishes on dM, so that df is conormal to dM and therefore represents a local 
section of C T*M. If, with local coordinates x, y±, . . . , y n — l and with respect to some 
frame (f>x . . . , <j) r of E and frame , . . . , ip s of T 1 , near we have 

^(E^)=2T m E £ al atl {x,y)D«[xD x ) k h^ v , 

ll n,v fc+| Q |<m 

then, away from the boundary, 

a(A)(df)(J2h^)=x- m J2 E < ail {x,y){d y fr{xd x f) k h^ v 

where by d y f we mean the gradient of / in the y variables. Since f = xg with 
smooth g, this is equal to 

E E al att (x,y)(d y gng + xd x g) k h^ v , 

fi,f k+\a\=m 

which is smooth up to the boundary. Suppose that / is another smooth function 
defined near po and vanishing on the boundary, so that / = xg for some g. Then 
the statement that 

df - df G 1 P0 (M) • C™(M; T*M) 
is equivalent to the statement that 

g(Po) = <j(Po) and d Vj g{p ) = d yj g(p ) for j = 1, . . . , n - 1; 
recall that po G dM. Thus if df and d/ represent the same element of c T po M, then 
lira ®{A){df{p))(ci>{p)) = lim a(A)(df(p))(0(p)) 

•n — *rtn n — *rtn 
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for any smooth section 4> of E defined near po- It follows that the function 

C T* & M 3!] k c tr{A){n) = a(A)( c ev(r))) 
extends by continuity to a function 

a section of Hom( c n*E : c tt*F) over c T*M\0. It is easy to see that c ar(A) is smooth. 

Definition 3.2. The section c ar(A) is the c-symbol of A. 

For example, with the notation above, taking g = £ + ^ IjUj with £ and jj real 
constants, and / = xg we get 

*(A)(df)C£h^) = Yl E < a ^vh a eh^„, 

^ fi,v k+\a\=m 

so if r] is the element of C T*M represented by df, then the right hand side of this 
formula is c *(A)(r))(£^ Wfa). 
By the definition, 

c <r{A){rj) = a(A)( c ev(r,)), V G C T* A M. 

From the fact that c ev is an isomorphism over the interior of M, invertibility of 
c ttw(A) over M is equivalent to ellipticity of A in that set. 

To relate the c-symbol of A and the ^-symbol of x m A recall first that if P G 
DiS^(M;E,F), then 

b <r(P)(*>ev*r)) =*(P)(r)), rjeT*M\0; 

here 6 ev* : T*M -> b T*Af is the dual of b ev : *>TM -> TM. Thus, if ?j G fc TM 
projects on an interior point of M, then 

V(x m A)(7?) = < 7(P)(( 6 ev*)- 1 (r?)), ?j G b T*M\0. 

The fact that x m A is totally characteristic implies that fj 1— ► <r(.P)(( 6 ev*) _1 (?7)) 
extends by continuity to the boundary. Let r\ £ C T*M project over an interior 
point. Then 

c a (A)(n) = «i(A)( c e V (T 1 )) = x~ m «j(x m A)( c ev(r ] )) 

= €r(x m A)(x- lc cv( V )) = b €r(x m A)( b ev*(x~ lc ev( V ))). 

Writing the map ij 1— > b ev*(x~ 1 c ev(?7)) in coordinates one sees that it extends as a 
smooth isomorphism x^ 1 : C T* M — > b T*M, so 

c ar(A)(r]) = V(x m ^)(x" 1 (r/)). 

In particular, invertibility of the c-symbol of A is equivalent to invertibility of the 
^-symbol of x m A. 

The isomorphism x~ x : C T*M — ► b T*M is determined by the defining function 
a;, so is not natural. Write x for its inverse. If x is another defining function for 
dM then x _1 x is multiplication by x/x; this is the reason for l|3.1() . 

Definition 3.3. The operator A G x~ m Diff?(M;E, F) is called c-elliptic if 

c a{A) G C^( c T*M\0;Hom( c 7r*£, VF)) 

is an isomorphism. If F = E, the family A t— * A — A is called c-elliptic with 
parameter in a set A c C if 

c ar{A) -AG C°°(( C T*M x A)\0; End(( c tt x mZ)*£)) 



GEOMETRY AND SPECTRA OF CONE OPERATORS 



11 



is an isomorphism. Here c ir x id : ( C T*M x A)\0 — > M x A is the canonical map. 

Let Xt be the one-parameter group of diffeomorphisms generated by the vector 
field xX, cf. Section^ Fix t and let rj G C c °^(Af; T*M). Then X *t V G C™(M; T*M), 
since \t° l = l - Since also Xt%xt(p)(M) = I P (M), we get a map 

X* : TM -» C TM, (3.4) 

a vector bundle morphism covering X— t- It is not hard to see that this map 
is smooth. If A G x- m mS^{M;E,F), let A g = g~ m K~ 1 AK g . Then A e G 
x- m F>m r b n (M;E) and 

c «r(A e ) = Q~ m K~ 1 ( c tr(A) o X*og g) K g- (3-5) 

Thus A e is c-elliptic if ^4 is. 

We now recall the definitions of conormal and wedge symbols, and of boundary 
spectrum. 

If P G Diff™(M; E) and if u is a smooth section of E that vanishes on Y = dM, 
then Pu also vanishes on Y. Therefore, if v is a section of E over Y and u is an 
extension of v, then (Pu)|y does not depend on the extension. Thus, associated 
with P there is a differential operator 

P(0) : C°°(Y;E\ Y ) -> C°°(Y;E\ Y ) 

of order m. Fix a G C. Since it i— > x~ 1<J P{x la u) is an operator in Diff™(M;i5), 
there is, for each a G C, an operator P(cr) G Diff m (F; P|y). The conormal symbol 
of P is defined to be the operator-valued polynomial 

C 3 a ^ P(cr) G Diff m (y ; E\ Y ). (3.6) 

It is easy to verify that P(u) is elliptic for every a if P is 6-elliptic. The boundary 
spectrum of P, cf. Melrose 0, Melrose-Mendoza !! . is 

spec b (P) = {a G C : P(er) is not invertible}. 

The definition of Pier) depends on the choice of defining function x but different 
choices of defining functions give operators related by conjugation with multipli- 
cation by e 1 " 9 for some smooth real-valued function <?, so the particular choice 
of defining function to define the conormal symbol is not critical. The conormal 
symbol of A G x~ m Diff™(Af; E) is defined to be that of the totally characteristic 
operator x' m A, and the boundary spectrum of A is defined to be that of x m A. 

If A G x- m Diff b "(M;P,P), then is a cone operator defined in V, cf. 

(12.91) . and if u G Cfi° (Y A ; E A ), then the limit in the following definition exists in 
C °°(r A ;P A ). 

Definition 3.7. The wedge symbol of A is the operator A A G Diff b rl (r A ; P, P) 
defined by 

A A u = lim Q m Kg($- l A$.)K- l u (3.8) 

g— >0 y 

Writing A as x~ m P and expanding P as in (|2.7|l with TV = 1 we get directly 
from the definition of A A that 

A A = x- m P A . 

where P A ,o is the operator on Y A that coincides with ( E'~ 1 Po$* near Y and satisfies 
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for all q > 0. Near Y (in M), with the notation and conventions of Section 
Po = J2\ a \+k<m a ka(y)Dy(xD x ) k near P where ak a (y) is independent of x. The 
operator P A ,o is the "same" operator (the pull-back by $), but on Y A , and so 

A A =x- m J2 a Uv)D*(xD x ) k 

\a\ + k<ra 

for all x. The conormal symbols of A and A^ are equal to each other, in coordinates 
the family 

x~ m a ka (y)a k D^ a EC. 

\oc\+k<m 

The wedge symbol A^ of A inherits properties of A. Using the tubular neigh- 
borhood map $ we also get a bundle isomorphism 

c r * F A c T * M 

covering $. It is not hard to verify that, over dY A = Y = dM we have 

c «r(^4 A )| o T .yA = c o{A)\c T * M . 

Thus c-ellipticity is preserved. 

Let A* be the formal adjoint of A acting on x~ m l 2 L\{M\E). Since and n e 
are isometries (the former near Y), 

o 

if u, v G C^ D (Y /X ; _E A ) and g is small. Thus, taking the limit as g — > we get 

(A A )* = (A*) A . (3.9) 

o 

Lemma 3.10. Suppose that A is symmetric on C£°(M; E). Then A A is symmetric 
on C^°(F A ; E). If in addition A is semibounded from below, then A^ is semibounded 
from below by 0. 

The first assertion follows immediately from (|3.9|1 and the hypothesis that A* = 
A. For the second, let C S K be such that 

(Au,u) x - m/2Ll > C\\uf x _ m/2Ll , u e C^(M-E). 
Suppose that u E C^{Y-E h ). Then 

{g m K,~ 1 (<&~ 1 A$i f )K e u,u) x - m /2 L 2 = Q m (A$*K e u,$*K g u) x - m /2 L 2 

> Cg m \\^^ e u\\l_ m/ 2 L 2 = Cg m \\u\\l^ /2L 2 

Passing to the limit as g — > we thus get the second assertion of the lemma. 

It also follows from l|3.8|l that the family A i— > A A — A satisfies the homogeneity 
relation 

A A - g m X = g m K e {A A - A)*" 1 for every g > 0. (3.11) 

Definition 3.12. A family of operators A(X) acting on a K-invariant space of 
distributions on Y A will be called K-homogeneous of degree v if 

A(g m X) = Q v K e A(X)K~ 1 

for every g > 0. 
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4. Closed extensions 

In this section we recall some known facts about the closed extensions of a c- 
clliptic cone operator A on a compact manifold and, where needed, sketch proofs of 
analogous results for the closed extensions of its model operator A^. Theorem 14. 121 
gives a natural isomorphism between T> max (A) /T> m i n (A) and Dmax^AV^min^A) 
that will play an important role in [2] but not in the remainder of the present paper. 
The rest of the material in this section will be used at various points in all later 
sections. 

Suppose that A G x~ m Diff ™{M;E), fix \i G M and consider A first as an un- 
bounded operator 

A : C °°(M; E) C x"L 2 b (M; E) -> x"L 2 b (M; E) (4.1) 

Write T> min (A) for the domain of the closure of this operator; with this domain, A 
is referred to as the minimal extension of A. The structure of T> min (A) when A is 
c-elliptic was characterized in Gil-Mendoza Proposition 3.6]. Define also 

= {u G x»L 2 b {M;E) : Au G x»L 2 b {M;E)} 

The maximal extension of A is 

A : V max (A) C x»L 2 {M-E) -> x»L 2 b {M; E), 

also a closed operator. The space Pmin(^) is a closed subspace of D max (A) in 
the graph norm defined by A, and all closed extensions of i|4.1|) have as domain a 
subspace of T> max (A) containing V min (A). 

It is well known, see Lesch [5], that if A is c-elliptic, then A with domain T> max (A) 
is Fredholm, T> m i n (A) has finite codimension in T> max (A), and if V is a subspace of 
T>nuui(A) containing V mhl (A), then 

ind A v = ind A Vtnln + dim V/V min . (4.2) 

Here means the operator 

A:V C x*Ll(M; E) -» x^L^M; E). 

The problem we wish to consider is the nature of the spectrum and structure of the 
resolvent of the closed extensions of (14.11) of index zero (if any). 
Since multiplication by x v is an isomorphism (in fact an isometry) 

x v : x»L 2 b (M;E) -> x^ +v L 2 b (M ; E) 

we may conjugate A with such operators with no essential change of the problem. 
For convenience we will work with the operator x ~^~ m / 2 Ax^ +m t 2 so as to base all 
the analysis on x~ m / 2 £g(Af; E). Clearly, x -^-m/2 js^^+m/i £ x~ m Diff^M; E). 
Since 

c o{x-^- rn l 2 Ax^ m l 2 ) = c <r(A), 

c-ellipticity is preserved by such conjugations. We thus assume that \x — —m/2. 
The standing assumption, unless otherwise indicated, will be that A is c-elliptic. 

We will usually abbreviate 2? m ; n (A) to X> m in and T> mslX (A) to X> max when the 
operator is clear from the context. As already indicated, the operator A with 
domain T> will be denoted by Ax>- 

The inner product 

(u, v) A = (u, v) x - m/ 2 L 2 + (Au, Av) x - m/ 2 L 2 (4.3) 
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on P max makes this space into a Hilbert space. 

Definition 4.4. The orthogonal of X> m ; n (A) in T> max (A) with respect to this inner 
product will be denoted £ max (A), or £ max if A is clear from the context. We denote 
by 7r max : 2? max (A) -> V max (A) the orthogonal projection on £ max (A), 

Since V mul is closed in D max , 

^max — -^min £B ^max 

and since Z? m i n has finite codimcnsion in X> max , £ max is a finite-dimensional space. 

Lemma 4.5. The space £ max {A) is equal to T> max (A) n ker(A*A + /), where the 
kernel is computed in the space of extendable distributions. 

Here A* is the formal adjoint of A in the space x~ m l 2 L\(M- 1 E), that is, 

(Au,v) = (u,A*v) Vu, w G C£°(M;E). 

It is immediate from the definitions of minimal and maximal domains that the 
Hilbert space adjoint of 

A : V min (A) C x- m ' 2 Ll{M; E) -> ^"^(M; £) (4.6) 

is 

A* : P max (A*) C x- m t*Ll(M;E) - x~ m l z L\{M; E). 

Proof. We first show that £ max C Z\nax(A) H ker(A*yl + /). If u G £ m axj then 
u G P max (A.) and 

(A!i,Al)) x - ro /2 i 2 = -(tt,u) :c -m/2 L 2 Vw G £> m in- 

b b 

Therefore the map 

V min (A) 3v^ (Au,Av) x - m/ 2 L 2 e C 

is continuous in the norm of x~ m / 2 L 2 (M; E), and consequently, Au belongs to the 
domain of the Hilbert space adjoint of (|4.6[l . Thus u G D max (A*A) and the identity 
(u, v)a =0,t)£ P min (A) gives 

(iMii, «) + (u, «) = Vv G C °°(Af; E) 

which gives that it G ker(A*A + I). Thus £ max C T> max (A) n ker(A*A + J). 

To prove the opposite inclusion, suppose that u G T> max (A) Dkei(A* A + 1). Then 
Am G x-' n / 2 L 2 b (M;E) (since u G V max (A)) and A*(ykt) = -u G x- m / 2 L 2 (M; E), 
so Aw G P max (A*). Thus 

(A*Au, v) = (Au, Av) W G C* °°(Af; £) 

o 

and it follows that (u, v)a = for all v G Cq°(M; -E). Since the latter space is dense 
in 2? m in, we get that u G £ max . □ 

In the course of the proof we also showed: 

Lemma 4.7. £ max (A) c V max (A*A). 

Since A is c-elliptic, so are A* and A* A + /. It follows that the Mellin transform 
of any u G £ m ax is a meromorphic function defined on all of C. 

We now discuss analogous aspects for the operator A A . The space T> m i n (A A ) is 
the domain of the closure of 

A A : C^{Y^;E) C x- m/2 L 2 b (Y A ;E) -» 2T m/2 Lg(y A ; £) 
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and 

P max (A A ) = {u G x- m ' 2 L 2 b (Y A ;E) : A A u G x^ 2 L 2 (Y A ; E)}. 

Since A A need not be Fredholm with either of these domains, we discuss these in 
some detail. We will usually write 2?A,min and 2?A,max for the minimal and maximal 
domains of A A . 

Lemma 4.8. Ifu G T> max (A A ) , then (l—u))u G T> m i n (A A ) f or ever V cut-off function 
uj with u> = 1 near x = 0. 

In other words, as far as closed extensions are concerned, there is no essential 
structure at infinity. 

Proof. Let j : Y A — > Y A be the involution (x,y) i— » (£, y) = (l/x,y). Under 
this map, Po = x m A A goes over to a certain other totally characteristic 6-elliptic 
operator P , A A goes to A A — £ m Po, and 

j* : x v Hg(Y A ,E) -» C V H^{Y A :E) 

is an isomorphism. We'll write it for Since Po is ^-elliptic, there are properly 
supported operators Q and R defined on extendable distributions such that for 
every v the operators 

Q : eL 2 (Y A ;E) - £ v H b m (Y A ; E), R : fL2(y A ; £) - ^H b x (Y A ;E) 

are continuous and 

QPo = I- R. 

If u G Pmax(A A ) then u G C /2 Lg(r A ; P) and £ m P w = / 6 ^ m / 2 L^(y A ; P). From 

Or "7 - gr m r i P^ = 

we get 

= QC m f + Ru 

with gr™/ G ^ m/2 H b m {Y A ;E) and #u G f "/ 2 P b °°(y A ; P). If w is as in the 
statement of the lemma, then (1 — cl>) is supported near £ = 0, so (1 — Cj)Ru G 
C n/2 H b m (Y A ;E). Thus (1 - <Z>)i2 G f"/ 2 Pg(T A ;P) Hf m / 2 ^(Y A ;£). Let X G 
Cq°(E) be such that = 1 near and let xt(€) = Define 

V£ = (l- xt)(l ~ &)u. 

Then v e G £ m / 2 L 2 (Y A ;E) n ^ m/2 H b m (Y A ; E) and -»• (1 - tD)u as ^ -> oo, in 
C n/2 L 2 (Y A ;E) as well as in £- m / 2 H b m (Y A ; E). From the latter we get that P Q v e 
converges in £~ m ' 2 L 2 (Y A ; E) to Pq(1 — uj)u as I — > oo, and consequently, that A A «£ 
converges in f"/ 2 L 2 (y A ;P) to A A (l-<Z>)u. This proves that (l-u)u G P min (A A ), 
since the are compactly supported. □ 

The structure of £>A,min near Y is described in the first two items of the following 
proposition, which can be proved using the same arguments as in the proof of 01 
Proposition 3.6]. The third follows from an analysis of Mellin transforms that takes 
advantage of the fact that the conormal symbols of A A and A are the same. An 
explicit, simple but fundamental isomorphism between the spaces X ) A,max/2?A,min 
and V max (A) /T> m i n (A) is given in Theorem 14. 121 

Proposition 4.9. Let A G x~ m Diff™(M; P) be c- elliptic. Then 
(*) 2>A,min = {u G £> A>max : urn G x m ' 2 -"H b m {Y A ; P) Ve > 0}. 
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(ii) X> A , min = x m / 2 Hl n (Y A ; E)nx- m / 2 Ll{Y^: E) if and only ifspec b (A) n {3ct = 
-m/2} = 0. 

(in) dim2? A , max /P A ^ min = dimV max (A)/T> min (A). 
On 2?A,max we take, naturally, 

(u,v) Aa = (A A u, A A v) x - m/ 2 L 2 + (u,v) x - m/2L 2 (4.10) 

b b 

as inner product. 

Definition 4.11. The orthogonal of £>A,min in £>A.max with respect to this inner 
product will be denoted £ m &x{A A ), or £A,max if A/\ is clear from the context. We 
denote by 7r A , m ax : £> max (A A ) -» V max (A A ) the orthogonal projection on £ max (A A ). 

The proof of Lemma l4~51 gives that £ A, ma x = £>A,max H ker(A A ^4 A + J). 

The following result, although elementary in nature, is of fundamental impor- 
tance in expressing the relation between the domains of A and the domains of A A . 
Let 

S = {a e C : -m/2 < Scr < m/2}, 

and for each a 6 5 let iV(cr) be the largest integer N such that 9<7 — N > —m/2. 
Let (jj, j = 1, . . . , v be an enumeration of the elements of £ — spec b (A) n S. 

Theorem 4.12. Let A be an arbitrary c- elliptic cone differential operator. There 
are canonical decompositions 

£max(A) = £{j j (A), £ max (A A ) = £(j j (A A ) (4.13) 
.7=1 J'=l 

smc/i i/iai 

(i) if u £ £ a ,(A), then u\^ t7> _ m / 2 } has poles at most at aj — id for *& = 

(ii) if u € £ r7 .(A A ), then u\^ a> _ m /2} has a pole at most at ay, 
(Hi) if ' u G £ a JA) or u 6 £ aj (A A ) and u is holomorphic at o~j, then u = 0. 

There is a natural isomorphism 

9 : £ ma M) -» £max(A A ) (4.14) 

such that for each j, 

0\ £ ^ {A) :£ a] (A)^£ lTj (A A ), (4.15) 
and for each j and for all u E £ (Tj (A), 

(Q~ 1 uju — 9uy is holomorphic near a j (4.16) 
where w S C^°(U; E) is such that lu = I near Y . 

Proof. For any open set U C C let Wl(U) be the space of meromorphic functions 
on U with values in C oc (dM; E\g M ). For a £ U let 9Jl ao (U) be the subspace of 
9Jl(U) consisting of elements with pole only at Co £ U. Finally let Sj(U) be the 
subspace of holomorphic elements. We let 

: Wl ao (U) -> Wl ao (C) 
be the map that sends an element in 9Jt CTo (t7) to its singular part at ctq- 
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If A = x-" l P with P G Diff™(Af; E), then near Y = dM = <9Y A we have 

in — 1 

x m A = P=J2 P k x k + P m x m (4.17) 

fe=0 

where each Pk, k < m, has coefficients independent of x, cf. Definition 12. 61 Then 

x m A„ = $- x Po$* 

near Y in Y A . Let Pfc be the conormal symbol of Pf.. The operator Pq is the 
conormal symbol of both A and A A . 

Let uo £ E, and let U C 5 be a neighborhood of do such that U n spec 6 (A) = 
{do}. Then P gives an operator 

V : Tt(U)/Si(U) -» 9Jl(U)/S)(U) 

whose kernel is finite-dimensional. Since Co is the only point of spec & (A) in C/, 
the elements in the kernel of V are represented by meromorphic functions on U 
with pole only at do- By taking the singular part of such functions we get a space 
£ ao {A A ) C Wl ao (C) with the property that h G 2tt CTQ (C) and P Q h G i5(C7) imply 
that there is a unique element ip G £o- (A A ) such that h — tjj £ F)(U): 

4 (^a) = {^(fliW-VW) : / 6 «(C0>. (4.18) 

If V G £ CTo (A A ), then there is u G x~ m/2 H^(M; E) supported in U such that 
u — ip is holomorphic in 5(7 > — m/2. Such it belongs to x _m / 2 L^(M; P), and since 
Pou = Po(m — ip) is holomorphic in Qcr > —m/2, we get that G Anax(^4 A )- If 

v G 2?max(^A) also has the property that v — ip is holomorphic in Scr > —m/2, then 
— w G D m i n (^4 A ), an d consequently 7T Aiinax <I>;7 it = 7T Aiinax ii. Thus there is a 
well defined operator Pa.o- : ^o-oC-^a) ~^ £max(A A ), characterized by the property 
that 

tp — [Pa.o-o V'P i s holomorphic in 3(7 > —m/2. 
From this property one obtains that 

s CT0 ([Pa,<7 #) = i> 
so the operator Fa,u is an isomorphism onto its image. Define 

e ao (A A ) =P A , CTo f ffn (A A ). (4.19) 

Clearly, if <ji, Oj G S and <7j / <Tj, then £ ai (A A ) n (A A ) = 0. 

If u G £max(^4. A ), then u is meromorphic in 3cr > —m/2 with poles in X, since 
Pom is holomorphic in 3(7 > —m/2. Therefore s CT (u) G £ CT (^4 A ) and u— s CT . (u) 

is holomorphic in 5cr > —m/2. Thus the Mellin transform of 

u = u -y^p A , - 3 s (7j .(M) 

3=1 

is holomorphic in Qcr > —m/2, and therefore u G P m i n (j4 A ). But since i; also 
belongs to £ m ax(^4 A ), v = 0. Thus we have l|4.13[l for the operator A A . 

We now construct the spaces £ aj (A) for A. Pick (7o G £ and let ip G ^^(A/^). 
Thus Poip is entire. Define e CTOi o as the identity map on £ ao (A A ) and inductively 
define 

e CTOi ,5 : 4„(A A ) -► 9Jt CT0 _ w (C), i? = 1,.. ., AT(ao) 
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by 

0-1 



Then 



P^ e (a)(e ao , e (iJj){a + i(0 - I))) (4.20) 



1=0 



is entire, and 



m -l N(a ) 
fc=0 1?=0 

is holomorphic in Ser > — m/2. Define 

4„(A) - { J] e ff0 ,4V) : ^ 6 4 (^a)}- (4-21) 

t?=0 



Given ^ £ £ CTo (A A ), choose for each ■& and element £ a; m ' 2 Hg°(M; J?) such that 
- e a0t ^(ip) is entire. Then « = £^G X> max (A). If the u<j e x- m / 2 H^{M;E) 
also satisfy the condition that — e ao ^{ip) is entire, then 7r max (w) = 7r max (u), so 
again we have a well defined operator F„ a : £ ao (A A ) — > £ max (A). This operator is 
injective; we let £ CTo (A) be its image. It is more tedious than hard to verify that 

(FTTil> holds. 

Define 9 so that gUfl holds, and on each (A), 6> = i^. o F" 1 . Then (|^TT^) 
also holds. □ 

Let 

T)(A) = {V C P max (A) : £> is a vector space and V min (A) C I?}. 

The elements of 5) (A) are in one-to-one correspondence with the subspaces of 
£max(A) via the map 

£ 3 V h+ V n 2? max (A) (2?) C £ max (A), 

so 2) (A) can be viewed as the union of the Grassmannian varieties of various di- 
mensions associated with £ max (A). Likewise let 

£> A = {D C IV, max : 2? is a vector space and £> A ,min C X>}. 

With the map 9 of Theorem 14.121 we then get a map 

e:£>(A)^D A . (4.22) 

5. Domains and spectra 

We discuss here the spectra and resolvents of the closed extensions of a cone 
operator A £ x~ m Diff™(M; E) in geometric terms. We continue to assume that 
A is c-elliptic and that M is compact. The results in this section will be relevant 
mostly in Sections and The conceptual point of view developed here will be 
taken up in Section [3 in the context of the model operator. 

We begin with the elementary observation that only those extensions of A that 
have index zero may have nonempty resolvent set. 

Lemma 5.1. There is T> G D such that indA-p = if and only i/ ind Ap min < 
and indAp max > 0. 
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Proof. If there is a domain T> € D such that iridic = 0, then the relative index 
formula (|4.2(l gives 

indAx> min < ind^4r> min + diml?/2? max = 

< ind A Vmin + dim£> max /X> min = indA Cmax . 

Conversely, suppose that < — ind ^4r> min and ind ^4x> max > 0. Using l|4.2[) again we 
get 

d = ind ^4x> max — hid -Ax> min , 

so — indv4p min < d, and there is a subspace of P max /I? m i n of dimension — ind Ap min . 
This subspace corresponds to an element V G 35 for which (|4.2[1 gives 

ind At> = indAx> min — indAp min = 0, 

which proves the lemma. □ 

The domains T> G 2) on which A has index are those in 

= {V G S : dimX>/r> rain = -indAp min }. 

By the lemma, © is empty unless 

indAr> min < and mdA Vm ^ > 0. (5.2) 

Assuming this, let d" = — indAp min . Then 

&3V^VD £ max = 7r max Z> e Gr d » (£ max ) (5.3) 

is a bijection between © and the Grassmannian of ^''-dimensional subspaces of £ m ax 
which we use to give © the structure of a complex manifold. Let d! = ind ^4-p max ■ 
Then d = d' + d" = dim£ max . 

An initial classification of points in the spectrum of a closed extension of A 
begins with the notion of background spectrum. 

Definition 5.4. The background spectrum of A is the set 

bg-spec A = {A € C : A G spec VT> € D}. 

The complement of this set, bg-res A, is the background resolvent set. 

Thus, if T> G ©, then A-p has as spectrum the (disjoint) union of bg-spec A and 
a subset of bg-res A. Note that the resolvent set iesAx> of Ax>, T> G (5, is contained 
in bg-res A. As we shall see, the part of the spectrum of Ar> in bg-res A is amenable 
to detailed study. The set bg-spec A has the same generic structure as a spectrum: 

Lemma 5.5. The set bg-spec A is either C, or closed and discrete. 

Indeed, bg-specA is an intersection of closed sets, so itself closed, and either all 
spectra are C or there is one extension with discrete spectrum. 

Thus bg-res A is open. A useful description of bg-res A is as follows. 

Lemma 5.6. 

bg-res A = {A G C : A-D mln — A is injective and A-r> max — A is surjective}. 
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Proof. If A G bg-res A, let T> G D be such that A ^ specAx>. Since T> min C T>, 
Ax> min — A is injective, and since I? C T> max , A-p max — A is surjective. Thus A £ 
bg-res A. 

Conversely, suppose that A belongs to the set on the right in the statement of 
the lemma. Let R C x~ m / 2 L 2 b {M] E) be the range of A£> min — A, and let R- 1 be its 
orthogonal. Since Ax> min — A is injective, dimi?^ = — indA£> min = d". Choose a 
basis /i, . . . , fd" of R- 1 . Since A£> max — A is surjective, we may choose u\, . . . , Ud" G 
2?max such that (A — X)Uj = fj for all j. The Uj are independent modulo T> m i n . Let 

£> = ^min © span{ui, . . . , 

Then T> £ 2) and Ax> — A is invertible, since i? is closed. □ 

Proposition 5.7. Suppose that <|5.2|l ZioZds and £/ia£ dim® > 0. Then, for every 
A G C. t/iere is D £ <S swc/i i/iai A G specAx>. 

Proof. Let A G C. If A G bg-spec A then in fact A G specAp for any T> € (S. 
Suppose then that A ^ bg-spec A, so by Lemma 15.61 there is T>o G 25 such that 
A-p — A is invertible. The hypothesis that dim (3 > is equivalent to the statement 
that the two numbers d" = — indAx> mln and d' — indA£> max are strictly positive; 
recall that their sum is d, the dimension of £ , m ax/£ ) min- Let w G 2?max\£V Such w 
exists because d" < d. Let / = (A — A)u>, and let u £ Do be such that (A — X)v = f. 
Then t«-))^0 modulo £> m in, and thus is an eigenvector of A. Let V G (5 contain 
u; — u; such 2? exists because d" > 0. Then Ad — A has nontrivial kernel. □ 

We will write JC\ for the kernel of Ax> max — A, A G bg-res A. For such A, 

dim K,\ = ind Ax> max , 
since Ax> max — A is surjective and its index is independent of A. 

Proposition 5.8. Let K, = Lhebg-rcs A ^ x an< ^ let p : K. bg-res A be the natural 
map. Then K, — > bg-res A is a locally trivial Hermitian holomorphic vector bundle. 

Proof. Let Ao G bg-res A, let /C^ be the orthogonal of K,\ in P max . The operators 
A l {X) = {A-X)\ Kxo A 2 (A) = (A-A)Ul 

are continuous as operators into x~ m ^ 2 L 2 {M] E) when the domains are given the 
graph norm of A, and depend holomorphically on A. Since A 2 (Ao) is invertible, the 
inverse A 2 (A) _1 exists for A close to A . It is easy to verify that if u a G JC\ , then 

u(A) = u - A 2 (X)- 1 A 1 (X)u Q G KLx 

for A close to Ao- These are, by definition, holomorphic local sections of /C. The 
statement that K, — > bg-spec A is a locally trivial holomorphic vector bundle follows 
by taking local frames near Ao of the form Uj (A) where the Uj form a basis of K,\ . 
The Hermitian form in JC is the one whose restriction to K,\ is the restriction of the 
inner product of £> ma x to K,\ . □ 

Note that if u, v £ IC\, then 

(u,v) A = (Au,Av) + (u,v) = (l + |A| 2 )(w,v). (5.9) 

Lemma 5.10. Let T> G ©. The following are equivalent: 
(i) A G res Ap,- 

(ii) A G bg-res A and K\ n V = 0; 
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(iii) A G bg-res A and n max IC\ H 7r max P = 0. 
Moreover, if X G resAx>, i/ien 

/C A © 2? = P max a"C? TTmax^A © ^maxP = 4iax- (5-11) 

Proof. To prove the equivalence of (i) and (ii), we recall first that res Ap C bg-res A. 
A point A € C belongs to resAx; if and only if ker(Ax> — A) =0, because A is 
Fredholm of index 0. But for A G bg-res A, ker(Ax> — A) = /Ca n P. Thus (i) and 
(ii) are equivalent. 

Suppose that A G bg-res A. If it G 7r max /CA H 7r max P, then u — <j) — v with G JC\ 
and v G £>min- Thus = u + v G 7r max P + P m i n = 2?, and so G /Ca PI P. If 
7i"max^A n 7r max X> 7^ 0, pick u / 0. Then </> 7^ 0, so /Ca flP / 0. Thus (ii) implies 

R. 

Again suppose that A G bg-res A. To prove that (iii) implies (ii) we will first 
show that 7r max |^ A : K\ — > £ max is injective. Let G /Ca. If ^max^ = then 
<f> G P m in- But A — A is injective on P m i n , so = 0. Thus if /Ca fl P 7^ 0, then 

TTmaxA^A H 7T max P =/= 0. 

To prove the last statement we first observe that 

dim/CA + dimP/Pmin = ind Au max — ind Ap min = dimfmax. 

This gives, in view of (iii), that Tr max lC\ © TmaxP = £ max - Adding T> mul to both 
sides of this formula gives /Ca + P = P m ax, but this sum is direct in view of (ii). □ 

The lemma gives 

spec A v = bg-spec A U {A g bg-res A : K,\ n P ^ 0} (5.12) 

for any P G 25. Since /Ca (~l P = if and only if 7r max /CA f~l 7r max P = 0, the presence 
of spectrum in bg-res A for a given extension A-p is a purely finite dimensional 
phenomenon. We will exploit this in Sectional to give estimates for the resolvent 
B-p(X) of At> — A in terms of a canonical right inverse of A-p max — A, a canonical left 
inverse for A-p min — A, A G bg-res A, and a finite dimensional projection. 

If A G bg-res A, more generally, if Ap max — A is surjective, then Au max — A admits 
a continuous right inverse -B m ax(A), namely, let /C^ C P m ax be the orthogonal of 
/Ca with respect to the inner product l|4.3|l (/C^ may not be, and does not need to 
be, an element of 0). The operator 

(A-\)\ Ki :ICi^x- m / 2 Lt(M;E) 

is continuous and bijective. Then the inverse, B max (X), of (A — A)|^x is continuous. 
For each A G bg-res A, the operator S max (A) has the smallest norm among all 
continuous right inverses of Ax> max — A. 

The operators B max (X) can be obtained from any family 

BLxW ■■x- m/2 Ll{M-E)-,V 1 ^ 

of continuous right inverses for Ax> max — A by means of the formula 

Smax(A) = B' max (X) - TOcX^cM (5-13) 

in which irjc x : P ma x —> /Ca is the orthogonal projection on /Ca (with respect to 

63). 

The -B m ax(A), as operators x m l 2 L\(M ; E) — > P max , depend continuously, even 
smoothly, on A. To see this, let A, Ao G bg-res A. Then 

(A - X)B max (X ) = ((A - A ) + (Ao - A))S max (A ) = / + (A - A)B raax (A ). 
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Since both -B ma x(Ao) : x m ' 2 L 2 {M\E) — > V max and the inclusion t : £> max 
x~ m / 2 Ll(M;E) are continuous, 

iB max (X ) : x- m / 2 L%(M;E) - x^L^M; £) 

is continuous. So if A is close enough to Ao, then 

^max(A) = -Bmax(Ao)(/ + (Aq — A)l£? max (A )) 

is a right inverse for Ax> max — A depending smoothly on A. Since the tt/c x , as 
operators P max — > D mm , also depend smoothly on A, the correction l|5.13[l gives 
the smoothness of A i— > £> m a X (A). 

The operators i? ma x(A) can be used to construct the resolvent of Ax> — A for any 
T> G (3, as follows. For each A G bg-res A such that /Ca n P = let 

^K X .V '■ Anax — > fc\ 

be the projection according to the decomposition (|5.11|) : this is a continuous op- 
erator. Noting that A G res A if and only if A G bg-res A and 1C\ fl V = 0, define 

So(A) = S max (A) - ^ A ,pS max (A). (5.14) 

Then TTfCx,T>BT>(X) = 0, so B-p(X) maps into £>. Since (A — A)7ix A ,£> = 0, -Bp (A) is 
a right inverse for Ax> — A, which must also be the left inverse because Ax> — A is 
invertible. 

The canonical left inverse for Ax> min — A is constructed in an analogous manner. 
Let 1Z\ be the range of -Ax> min — A, A G bg-res A (more generally, one can let A 
belong to the set where Ax> miri — A is injective). Since A-z> min — A is injective if 
A G bg-res A, Ap min — A : V min — » 1Z\ has a continuous left inverse B^-^X). The 
orthogonal TZj^ has dimension — indAx> min . Let i? m ; n (A) be the composition of the 
orthogonal projection on TZ\ followed by B® nin (X). Viewing IZj; as the kernel of 
A* — A on X\nax(^4*), we see that Lhebg-spccA ^ A ^ s a smooth (anti-holomorphic) 
vector bundle over bg-res A. An analysis similar to that done for -B max (A) gives 
that -B m in(A) depends smoothly on A G bg-res A. 

If B' min (X) is a left inverse for A-p min — A, A G bg-res A, and 7Ttj a is the orthogonal 
projection on K x (in x" m / 2 Lg(M; E)), then 

B min (X) = B' min (X)nn x , (5.15) 

and so 

||-B min (A)||^ f ( :I ,- m /2 i 2 jX , max - | < ||-B m i n (A)||_ Sf ( a .-m/3 i 2 X) mM )- 

Let V G & and let B-p(X) be the resolvent of Aj> — A. It is immediate that the 
formula 

BvW = B min (X) + (J - B min (X)(A - X))B V (X) (5.16) 
holds. Replacing (|5.14l) in this formula we get 

Bv{X) = B max (A) - (/ - B min (X)(A - A))^c A , c B max (A). (5.17) 
Letting 7r m j n = I — 7r max we see that that 

^Kx-V — ^Kx-V^raayi + TTrnin) = 7I"K A ,C 7r ma X ■ (5.18) 

The operator / — B ln i n (X)(A — A) is a projection with kernel P m m so 
/ - S rain (A)( J 4 - A) = (/ - B min (X)(A - A))^ max . 
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Thus we arrive at 

B V (X) = B max (X) - (I - B min (X)(A - A))7r max 7r KA ,r>7r max B max (A), (5.19) 
a formula which will prove to be very useful. 

Remark 5.20. The range of the projector I— B min (\)(A— A) contains JC\ so there is 
no difference between (|5.17|l and l|5.14ll . Writing -Bp (A) in the form H5.19fl separates 
the geometric information, in 7r max 7De A .-D7r max , from analytic contributions. 

We now focus on 7r max 7r^; Ai x)7r max , in particular its norm as a map £ max — > Smax- 

Lemma 5.21. Let V £ ®. Suppose A G bg-res A and K,\ Pi V = 0. Then 
^max^Kx^g is the projection on TT max IC\ according to the decomposition £ max = 

Proof. The map 7r max 7rx; A .-p| e is a projection. Indeed, in view of (|5.18() . 

7'"max7'"/C A ,-D 7r max7'"KA,X)| £max = ^max^A ,V^ICx ,T> | £ max = ^max^A ,£> \ , 

The operator 7r max 7r^ A t x> \ £ has kernel containing 7r max 2?, since the latter space is 
contained in T>, and range contained in 7r max X,\- To complete the proof we only need 
to show that ker7r max 7r KA ,-D| e = 7r max X>. Suppose that u £ ker7r max 7r KA!C | £ 
Then <f> — tt/Cx.vu £ K\ has the property that 7r max = 0. Thus <f> £ V mm . But since 
A — A is injective on 'D m i n (since A £ bg-res A), = 0. That is, u £ ker7i7c Ai p. Since 
u is already in £ max , this gives u £ V n £ m ax- But the latter space is 7r max ZX □ 

In the course of the proof of Lemma f5. 101 we showed that if A £ bg-res A, then 
TTmaxIfcA : — ► ^max is injective. Thus, since the spaces K,\ have dimension 
d' = ind ^4x> max , we have a map 

bg-res A 3 A h-> Tr max IC\ £ Gr d -(£ max ). 

Write /C max for this map, so /C max (A) = 7r max /C A - If A £ bg-res A, let 0i, . . . , 0d' 
be a holomorphic frame of /C, cf. Proposition 15.81 near Ao- Thus, in addition to 
independence, the maps A i— > 4>j(X) are holomorphic for A near Ao- If Ui, ■ ■ ■ , lid is 
an orthonormal basis of f max , then /C max (A) is spanned by the vectors 

7Tmax</>i(A) = ^ (</>•," ( A) , U k )u k , 
k 

which depend holomorphically on A. Thus /C max : bg-res A — > Grd/(£ max ) is holo- 
morphic. 

If T> £ 25, then Lemma [5.101 asserts that A £ bg-res A n spec Ax> if and only if 
TTmax^A H 7r max P ^ 0. Writing W = 7T max P, let 

2Jw = {V G Gr d ,(£ max ) : V n W ^ 0}. 

Then 

A G bg-res A n spec Ad <^=> /C ma x(A) £ 3J>v- 
Definition 5.22. For any nonnegative integer do < d and W G Gr £ j (f ma x) let 

2Jw = {V G Gr d _ do (£ m ax) :VnW/0}. 
If P G D, we write QJ-p for ^ mBX v- 

Thus spec is the union of bg-spec A and the pre-image of Q3x> under the map 
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Proposition 5.23. The set QJyv C Gr^' (£ m ax) is a variety of (complex) codimen- 
sion 1. For each T> € 35, 

spec = bg-spec A U /C~ ax (2Jx)). 

This is a disjoint union. 

Proof. We already showed the second statement. To prove the first statement, fix 
an ordered basis u = [m, . . . , uj] for £ max . Pick some point Vo € Gr<f (£ ma x) and 
let 3? = [<f>x, . . . , (f>d>] be a holomorphic local section defined near Vo of the bundle 
of ordered bases of the canonical bundle over Grd/(£ max ). Thus 

*(V) = u-Z(V) 

for some matrix Z(V) G M dxd (C) depending holomorphically on V. Let SI* = 
[ifo.,. . . , V«H be a basis of W, so \f = u • W with W G M dxd "(C). Then 

/(V) = det[Z(V)|W] 

is holomorphic in V. Since [<&(V),\P] fails to be a basis of £ m ax if and only if 
VnW/fl, /(V) vanishes if and only if V n W ^ 0. Thus QJyy is a complex variety 
of codimension 1. □ 



The norm of the factor 7r max 7r^ Ai p7r max in l|5.19|l . defined for A e bg-res A\ spec A, 
can be estimated in quite simple terms. Using Lemma l5.21l the problem is generally 
to estimate, for any W £ Grd (£ max ) and V € Grd_<2 (£ max )\2Jw, the norm of the 
projection 

^*V,W • £max ^ ^max 

(5.24) 

on V according to the decomposition £ max = V © W. We assume that the integer 
do satisfies < d < d. 

Let then W G Grd (£ max ). Fix ordered orthonormal bases u = [tti, . . . ,Ud] 
for £ max and * = [ipx, . . . ,ip do ] for W. Let V S Gr d _ do (£ max ) and let $ = 
... , 0d-d o ] be an ordered orthonormal basis of V. There are unique matrices 
V g M dx( - d - do ^(C), W G M dxdn (C) such that 

* = u -y, * = u • 

Define 

(5(V, W) = |det[V|W]|. 

The columns of V 7 , likewise the columns of W, form an orthonormal set of vectors 
in C d . We claim that S(V, W) is independent of the choices of orthonormal bases 
d> and SI/. Indeed, if <I?' and SP' are other choices of ordered orthonormal bases of, 
respectively, V and W, then <&' = <& • U\, \J/' = \& • 11% with unitary matrices t/i 
and U 2 . Thus *' = u VU X and = u VFJ7 2 - But 

[VUx,WU 2 ] = [V\W] q X ^ 

so | det[^[/i|VK[/ 2 ]| = | det[V"|VK] det J7i det t/ 2 | = det|V|W]| since unitary matrices 
have determinant of modulus 1. Thus we get a globally defined function 

8 : Grd-d (£max) x Gr<z (£ max ) — > M. 
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This function is clearly continuous, and QJyv is the set of zeros of V i— ► S(V, W). 
Suppose V ^ 23yy and let 7rv,w : £max — > V be the projection (|5.24(l on V. The 
basis u can be written in terms of the basis [«&, VP], as 

u =[*,*]• g 

where Q is the inverse of P = \V\W]. Let P be the matrix of minors of P, so that 
Q = (det P)~ 1 P. The entries of P are polynomials of degree d — 1 in the entries of 
P. Since the columns of the latter matrix are vectors in the unit sphere in C d , the 
entries p\ of P are bounded by a constant independent of P. If u = ^2 o^ug £ f max , 
then the two terms in 

d— do d n r 1 ^0 



U ■ 



detP 

fe=l £=1 



fc=l £=1 

correspond to the decomposition £ max = V © W. Thus 

d—do d 



^ u 



k=l 1=1 

This gives: 

Lemma 5.25. Let W £ Gr,j (£ max ) and let V £ Grd_ f j (f max )\5Jvv- Then 

C 

hvM - WWy 

The constant C is independent ofV. 

The question arises as to whether there is P £ © such that spec A-p is discrete. 
The following proposition shows that if there is one such domain, then the set 
of such domains is open and connected, and its complement is a set with empty 
interior. 

Proposition 5.26. The set 

53 = {P £ © : spec = C} 

is a variety. Thus, since 25 is connected, 23 ^ 25 if and only if 03 has empty interior. 

Proof. We identify 25 with Grd»(£ max ) using the map \b.'6\ . Let 7 — > Grd"(£ max ) 
be the canonical vector bundle. This is a holomorphic vector bundle. Let T>q £ 25 
and let u±, . . . , Ud>> be a holomorphic frame for 7 in a neighborhood U of T>q. Thus, 
if u\, . . . , u d is a basis of £ max , then 



x J (23)=g^(23)uS, j = l,...,d" 



yj\u)u t , j = 1,.. .,d" 
£=1 

with holomorphic functions : U — » C. Any u £ T> £ U can be written uniquely 
as 

d" 

u = w + oPuj(T>) 
2=1 

with u G P min . For T> £ U define P(P) : P -> P by 

d" d" 
P (P) (u + ^ « 3 (P ) ) = v + a? u.j (P) , v£ P min . 

2=1 2=1 
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This operator is bijective, and continuous in the graph norm of A. The operators 

A(V, A) = (A - A) o F(V) : V x- m ' 2 L 2 b {M; E) 

depend holomorphically on (V, A) G U x C, and the invcrtibility of Ax> — A is 
equivalent to the invertibility of A(T>, A). 

If T>o 23, then there is Ao ^ spec Ap , and therefore, there is a neighborhood 
U' C U of D and e > such that A(£>, A) is invertiblc for (D, A) e [/' x S(A , e), 
where £?(Ao, e) is the open disc in C with center Ao and radius e. Thus U' is disjoint 
from 23, which proves that 23 is closed. 

Suppose that Ao G spec A-p , let if = ker(Ax> — A ), and let K ± be the orthogo- 
nal of K in Do- Let R = (A — X )(V ), let i?- 1 be the orthogonal in x- m l 2 L 2 {M- E) 
of R, and let tt r and 7r fl -L be the respective orthogonal projections. Define 

A n =n R ±A(V,X)\ K A 12 =w R ±A{V,X)\ K ± 
A 21 =ir R A(V,X)\ K A 22 = w R A(V,X)\ K ± 

so that 



A(V,X) = 





A 12 ~ 


K 


R^ 


'A n 


A 21 


A 22 _ 


: © - 
K 1 - 


-> © 
R 



The operators Aij are continuous as operators into their target spaces as subspaces 
of x~ m / 2 L 2 {M; E) when their domains are given the graph norm of A, and depend 
holomorphically on (2?, A) for T> € U and A close to Ao. S ince A 22 {T)q^ Ao) is 
invertible, we can, perhaps after shrinking U, find e > such that A 2 2(2?, A) is 
invertible if V G {/ x _B(A , e). If (2?, A) G f7 x _B(A , e), the elements of the kernel 
of Ad — X are in one-to-one correspondence with the elements in the kernel of 

A = A U - A 12 A 2 *A 21 : K — > R 1 ^ 

via the map 

ker *A 3 u 1 ► u A 22 A 2i u G ker^4(X>, A) = kcr A v - A. 

Since A-p has index 0, K and R 1 - have the same dimension. Picking bases of K and 
R^- we can define a determinant f(D,X) for A Since A depends holomorphically 
on (V, A), so does /(X>, A). The set 

{(X>,A) Gf/xB(A ,e) :/(P,A) = 0} 

is the intersection of 

specA = {(V, A) G x C : A G specAp} 

with U x B(Ao,e) (thus spec^4 is a variety). Write / as 

00 

/(X>,A) = £/ / (X>)(A-Ao) / ; 

the functions are holomorphic in U. If 2? G t/ l~l 23, then /(2?, A) = for all 
A G B(A ,e), so / £ (X>) = 0. And if this condition holds for V, then f(D, A) = 0. 
So 23 n [7 is the set of common zeros of the functions fe : U — ► C, and 23 is a 
variety. □ 



The following gives examples where 23 is not empty. 
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Example 5.27. Let A = e~ ipx D x on the interval [-1, 1], with p £ C, p ^ 0. This 
is a cone operator: 

A = {l-x 2 )- 1 e- ipx {l-x 2 )D x 

and (1 — x 2 ) vanishes simply at x = ±1. We consider this operator initially as an 
unbounded operator 

cg°(-i, i) c (i - x'y^LK-i, i) - (i - x 2 r 1/2 ^(-i, i) 

with the measure m = (1 - x 2 )~ 1 dx. The space (1 - x 2 ')~ 1 l 2 L\{— 1, 1) is just 
L 2 (— 1, 1) with the measure dx, so the domains of the minimal and maximal exten- 
sions are, respectively, the standard Sobolev spaces Hq[—1, 1] and H l (— 1, 1). Since 
1, 1) consists of continuous functions on [—1, 1], the elements in 2? max can be 
evaluated at x = — 1 and at x = 1. The Mellin transforms at either boundary 
of elements of (1 — x 2 ) _1 / 2 i^(— 1, 1) arc holomorphic in Scr > 1/2, of course. To 
compute the conormal symbol of P = e~ %px (\ — x 2 )D x at x = —1 let xl = 1 + x. 
Then 

P = (2 - xjJe-^-^XLA^ = 2e- i ^- 1 )x L £> XL - XLe"^-^^ 

so the conormal symbol of P at x = — 1 with respect to xl is 2ae lp , giving a simple 
pole at a — for the inverse of the conormal symbol. If u £ T> maX} its value at 
x = — 1 is essentially the residue at o = of the Mellin transform of u. Using 
xr , = 1 — x as defining function for {x = 1} we get 

P = -(2 - x R )e- ip ^- x ^x R D XR = -Ze-^-^x^D^ + x R e- ip ^- x ^x R D XR 

and the conormal symbol at that boundary is — 2ae~~ lp . Since the only point in 
spec & (P) is 0, we deduce that £> m i n = (1 — x 2 ) x l 2 ll\ and that 

Anin = {u £ 2? max : u(-l) = u(l) = 0}. 

The operator A with the minimal domain is injective. The formal adjoint of A is 
A* = e tpx (D x +p), and the Hilbert space adjoint of Ap min is A* with its maximal 
domain, T>^ mx - The latter contains the function e~~ lpx , which spans the kernel of 
A*, so the index of ^4x> min is —1. This also gives that the index of ^4p max is +1. 
The domains on which A has index are of the form 

= {u£ X> max : a_u(-l) + a+u(l) = 0} 

with (a_,a+) £ C 2 \0. If z ^ then (za_,za + ) determines the same domain as 
(a_, a + ), so ©, the manifold of domains where A has index 0, is CP 1 = S 2 . 
Fix some (a_, a + ) £ C 2 \0. The kernel of (v4 — A) on £> max is spanned by 

h x {x) = e^/". 
The condition that h\ £ T> a _^ a+ is 

a_e x ^ P / p + a + e Xe * P / p = 0, 

equivalently 

a_ + a+e 2 ^ 1 sinp = a_ + a+e^- 6 ^]/" = 0. 

Thus, if p £ 7rZ (p 7^ 0), then a_ + a + =0 implies specAx> a _ — C while 
q:_ + a + 7^ implies spec A-p a _ a+ = 0. And if p £ 7rZ, then for any 6 
C 2 \0, the spectrum of Aj) a _^ + is discrete, and empty if either a_ or a + = 0. 
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6. Selfadjointness 

We now discuss the important case where A is symmetric on 2? m in from the 
perspective of Section [S] The selfadjoint extensions of such operators were studied 
by Lesch Suppose A is such a c-elliptic symmetric operator. Since 

||(A-A)«|| > |3A|||u|| HueV min , 

Avtnin ~ A is injective when 3A ^ 0. Since A is Fredholm and the Hilbert space 
adjoint of Ap min is A with domain T> max , ^4r> max — A is surjective if 3A ^ 0. Since 
the operators ^4i? min — A are Fredholm and depend continuously on A, the indices at 
A = i and A = — i are equal. So the deficiency indices are the same, and A admits 
selfadjoint extensions. If Ax> is one such extension, then specie C K, therefore 
bg-spec A is a discrete subset of E. 

The Dirichlet form of a general cone operator A is the sesquilinear form 

[u, v] A = (Au, v) - (u, A*v), u g V max (A), v g V max (A*). (6.1) 

It has the property that 

[u,v]a = [^maxU,TT max v]A, 

because [7r max u, TT m i n v]A = [^minM, ""min^A = for any u and v. Moreover, the 
induced sesquilinear pairing 

£max(A) x £ ma x(A*) -> C is nonsingular (6.2) 

(cf. Theorems 7.11 and 7.17 in 4 ). If V g D(A), let JV g D(A*) be the 
annihilator of T> with respect to the pairing l|fi.l|l . Thus if V g J), then the Hilbert 
space adjoint of A-p is Ay^-,. We will prove in a moment that the mapping J : 
T)(A) -> D(A*) is real-analytic. Let J* : l S(A*) -> D(A) be the analogously 
defined map. Clearly J* J is the identity. If A is symmetric on £> m i n and T> g 0, 
then J7 : © — > (5, J'* = ^7, and is selfadjoint if and only if 2? is a fixed point of 
J. Such domains will be called selfadjoint. 

Lemma 6.3. Let A be an arbitrary c-elliptic cone operator, 
(i) If ' u g £ m ax(A), then Au g £ max (A*). The map 

fmax(A) Aug £ max (A*) 

is an isometry. 
(ii) IfuE £ m ax(A) and v g T> max (A*), then 

(Au, v) A * = [u,v] A - 

(Hi) Let T> g D(A). Ifu£ T>n£ max (A), then Au is orthogonal to JT> with respect 
to the inner product defined by A* . 

Proof. To prove the first assertion in (i), suppose u g £ max (A). Then Au g 
V max (A*). In addition, A* Au = -u, so AA*(Au) = -Au, that is, Au g £ max (A*). 
If u, v g £ max (A), then 

(Au,Av) A * = (A*Au, A*Av) + (Au,Av) = (u,v) + (Au,Av) = (u,v) A - 

For part (ii), suppose u and v are as indicated. Then 

(Au,v) A * = (A*Au, A*v) + (Au,v) = (~u,A*v) + (Au,v) = [u,v] A . 

For part (hi) we observe that if u g T> and v g JT>, then [u, v]a — 0, and use part 
(ii). " □ 
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Proposition 6.4. The mapping J : T>(A) — > D(A*) is real- analytic. 

Proof. Let T>o € S(-A), and let <fii , . . . , 4>d be an yl-orthonormal basis of £ max (A) 
whose first do elements form a basis of T>q n £ max (^4). Let tpj = Afy, j = 1, . . . , d. 
The ipj form an orthonormal basis of £ max (A*), by part (i) of Lemma l6.3l Therefore, 
by part (ii) of the same lemma, 

[4>j,ip k ]A = S jk . (6.5) 

We deduce that 

JV = span-f^do+i, ■ ■ ■ ,ipd} © T> m i n (A*). 
Write *i = [0i, . . . , do ], * 2 = [0d o +ii • • • > 0dL and analogously *i, * 2 The set 

{span(*! + * 2 • Z) : Z e M (d - do)xd ° (C)} 

is a neighborhood of 2? m ( a component of) D(A), and the map 

Z i— > span($i + $ 2 • 2") 

is the inverse of a holomorphic chart. Likewise, parametrize the (d— do)-dimensional 
subspaces of £ max (j4*) in a neighborhood of JT> by 

VL" i — ► span(* 2 + *i • W) 

with W e M doX ( d - d °)(C). The condit ion that the vector space spanned by 

dp 

tl>k+d +^2 W k^h k = l,...,d-do 
i=i 

is [•, -]A-orthogonal to 

d—do 

^3 + Z j ( f )k + d o ' j = 1 , ■ ■ ■ , do 

fe=l 

is Zj+W k = because of <|6.5[1 . Thus, in coordinates, J" maps the space determined 
by Z to the space determined by W = —Z*. We conclude that J is real-analytic. 

□ 

Since J is real-analytic, its set of fixed points is a real-analytic variety. In fact: 

Proposition 6.6. Let A be symmetric on £> m in- The set 621 of domains D 6 
such that Ax> is self adjoint is a real-analytic (smooth) submanifold of (5 of codi- 
mension (d!) 2 , dl = indj4x> max . 

Proof. If indA-p max = then also indA-p min = 0, 2? m i n = 2?max, and Ax> min is 
the only selfadjoint extension of A. Assume then that indAp max > and pick a 
selfadjoint domain 2?o- Let cf>i, . . . , <f>d' be an orthonormal basis of T>q n£ max . Then 
[4>j,4>k\A = 0. By part (i) of Lemma [(j. 31 (A(f)j , A<f>k)A — Sjk- Thus by part (ii), 
[<f>j,A4>k]A = (A<j>j,A<f>k)A = 5jk- Also by part (ii), [A<j>j, A(f>k]A = ~(<f>j, A(j)j)A, 
which vanishes by part (iii). As above, write $i = [0i, . . . , 4>d>] and let «& 2 = 
[A(j>i, . . . ,A(j>d']- So a neighborhood U C © of Po is parametrized by the vector 
spaces associated with the bases <&i +$2 ■ Z, Z 6 flt(C, d'). Writing the components 
of <&i + *2 ' Z as 

d' 

4>i + Y^ z *Mh, j = i,-..,d' 
k=i 



30 



JUAN B. GIL, THOMAS KRAINER, AND GERARDO A. MENDOZA 



we see that the selfadjoint domains in U are those that satisfy 

4-^ = 

(i.e., Z is a selfadjoint matrix). These equations represent (d 1 ) 2 real-analytic con- 
ditions. □ 

Proposition 6.7. Let A be symmetric on T> mm and assume that — indAx> min > 0. 
For any A6l there is T> £ S21 such that A £ spec Ap. 

Proof. If A belongs to bg-spec A then A already belongs to the spectrum of any 
extension, selfadjoint or not, of A Suppose A £ bg-resA If u, v £ IC\, cf. 
Proposition 15. 81 then 

[u,v] A = 2i$s(\)(u,v), 
so if A is real, then the Dirichlct form of A vanishes on IC\ . Since 

dim 1C\ = ind Ax> max = — ind Ap min , 

and since 7r max is injective on IC\, 

Pa = Kx + Ani„ (6.8) 

is an element of 25 on which the Dirichlet form vanishes. Thus Ad is selfadjoint, 
and A £ spec Ap . □ 

Note that there is no assumption on semiboundedness of A. 

Proposition 6.9. Let A be symmetric on 2? m in- Then 

bg-specA= P| specAp. (6.10) 

vee% 

Proof. If indAp min = 0, then 25 = {2? m in} and bg-spec A = specAp mI11 . Since 
4p nin is already selfadjoint, (|6.10l) is an identity. 

Suppose then that — ind Aj} mln > 0. Denote the set on the right in l|6.10|l by S. 
From the definition of bg-spec A we get bg-spec A C S. 

To prove the opposite inclusion suppose that A £ bg-resA If 5A ^ 0, then 
A ^ S, since S C R. If A £ R (~l bg-resA, consider Ap Xo , where V\ Q is as in 
(|6.8|) . From the proof of Proposition 16.71 we know that Ad Xo is selfadjoint. Since 
Ap A is Fredholm and spec Ap> A ^ C, this spectrum is discrete. Since K\ Q C T>\ , 
A £ specAp Ao . We can therefore find a neighborhood U £ bg-resA of Ao with 
the property that U (~l spec Ap Ao = {A }. We claim that if A £ C/\{Ao}, then 
Ao ^ specAp A . To see this, let A £ U and assume that Ao £ specAp A . Then 
K\ a C\T>\ ^ 0. Thus there are <f> £ JC\ with <j> ^ 0, and i/j £ IC\, v £ 2? m i n such that 
<p = ijj + v. The element — v £ 2?a is equal to i/;, so X>a fl /Ca 0. Necessarily 
^> 7^ 0, since 7r max </> = 7r max ^ and (j> ^ 0. Thus A £ f7 H spec Ap Ao , which implies 
A = A . It follows that if A £ U nR\Ao, then T>\ £ 621 and Ao ^ spec Ap A , hence 
A 4- s - Therefore S C bg-spec A □ 

7. The model operator 

In this section we focus on the spectra of closed extensions of the operator Aa , cf 
(|3.8(l . We continue to assume that the operator A £ x~ m Diff™(M; E) is c-elliptic. 
We will usually write 2?A,min for V m i u {A^) and 2?A,max for l? max (AA)- Recall that 
the inner product on X> Ajlnax is given by (|4.1U|I . The nature of 2?A,min was described 
in Proposition 14.91 We also noted there that PA.max/^A.min is finite dimensional. 
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Because of the finite dimensionality of this quotient, many of the results concerning 
the closed extensions of A find their analogue in the situation at hand, despite the 
fact that neither of the operators 

A A : Z> A , min C x- m / 2 L 2 b (Y A ;E) - x- m ' 2 L 2 {Y A ;E) 

nor 

A A : P A>max C x- m / 2 L 2 (Y*;E) - x~ m i 2 L 2 {Y A - E) 

needs to be Fredholm. On the other hand, the homogeneity property 

A A — A = g m K e (A A - X/g" 1 )^ 1 for every g > (7.1) 

of A A — A, A G C, cf. (|3 . 1 1 1> . not available in such simple form in the case of A, 
permits an essentially complete understanding of the spectra and resolvents for the 
closed extensions of A A . 

We begin our analysis with: 

Definition 7.2. The background spectrum of A A is the set 

bg-specA A = {A G C : A G specA AiTI VP G D A }. 
The complement of this set, bg-res A A , is the background resolvent set. 
The analogue 

bg-res A A = {AeC: ^4 A ,r> min — A is injective and ^4 A .r> max — A is surjective} 
of Lemma f5 . 61 holds for A A in place of A, with the same proof. 

Lemma 7.3. If X € bg-res A A and T> G D A , then A A _x> — X is Fredholm. The set 
bg-res A A is a union of open sectors. 

Proof. Let A 6 bg-res A A . Since X> A ,max/2?A,min is finite dimensional and A A — X is 
injective on X> A ,min, ^4 A .-D max — A has finite dimensional kernel. Thus A A ^ mall — A is 
Fredholm, and so is its restriction to any subspace of 2? A ,max of finite codimcnsion. 
Next, suppose that Ao G bg-res A A and let A = g m Xo. Since n B is invertible and 

A A — A = g m n g (A A - Ao)*;" 1 , 

A A — A is injective on 2? Ajm i n and surjective on 2? A ,max- Thus the ray {VAo : r > 0} 
is contained in bg-res A A . Since Ao G bg-res A A , A A — Ao admits a continuous 
left inverse B(Xq) : x~ m l 2 L\{Y A - 1 E) — > V A ^ n . Since the inclusion 2? A , m i n ^ 
x~ m / 2 L 2 (Y A - ) E) is continuous, the formula 

B(X a )(A A - X) = I + (X Q - X)B(X a ) 

gives that (A A:min — A) admits a left inverse if A is close to Ao- Likewise (A Aimax — A) 
admits a right inverse if A is close to Ao- So bg-res A A is open. Therefore its 
connected components are open sectors. □ 

o 

Label the connected components of bg-res A A by A Q , a G 3 C N. Since the 
inclusion map V x- m / 2 L 2 (Y A ]E) is continuous for any T> £ £> A , 

o 

A Q 3 A i — > ind(A Aj x) — A) 

is constant, and 

ind(A Ai x> - A) = ind(^4 Ai x> mlo - A) + dim'D/XV.min, A G bg-res A A . 

Let 

d' a = md(A AtVm ^ - A), d" a = — ind(A A ^ min - A), A G A a 
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and let 

©a,« = {V G £ A : dimP/P A , min = <}, a£l 
The elements of © A q are thus the domains P for which A A d — A has index when 
A G Aq.. Write £ A , m ax for the orthogonal of P A , m i n in Pa, max- Using that 

£> A 3 2? h-> X> n f A , max 

is a bijection onto the set of finite dimensional subspaces of £ A , ma x we give each of 
the ®A.a the structure of a complex manifold. 

The proofs of the following lemma and proposition parallel the arguments in the 
proofs of Propositions 15.71 and 15.261 respectively. 

o 

Lemma 7.4. For every a G 3 such that dim ®a,q!,o > and every A G A a i/iere is 
T>q G © A , Q smc/i f/ia£ A G spec.A A ,x> . 

Proposition 7.5. For ewer?/ a 6 3 i/ie sei 

5J Q = {P G e5 A , Q : A Q C specA A ,x>} 

is a variety. 

If P G S A , then K e P is again an element of J) a- Indeed, 

P A ,min C KgP C Pa, max 

since both V^ mlu and Pa, max are K-invariant. Define 

* e : 3) A 2) A , K e {V) = K e V. 

Since k„P a ,min — Pa .mm ) 
and therefore the map 

K 9 £ I— > 7T A maxte? c- : ^A.max — * £ A ,max (7-6) 

is a (continuous) one-parameter group of isomorphisms of £ A . max , necessarily given 
by exponentiation of its infinitesimal generator. So l|7.6|l extends to a holomorphic 
action of C on £ A ,max' We will use the notation K e (V) for 7r A , m axK e (V) when 
V C £ a, max is a subspace. 

Proposition 7.7. Let do < d = dim £ A , max &e a nonnegative integer. The map 

K x Gr^ (£ Ajmax ) 9 (f,V) K e5 V G Gr do (£ A , max ) 
extends to a holomorphic map 



K, 



cxp ■ 



x Gr,j (5 A ,max) — * Gr<j (£ A , max) 



urtf/j £/ie property that 

Koxp(C + C, V) = /C oxp (C, Kcxp(C', V)) 

for all (, (' £ C and V G Grd (£ A , max ). ^ n particular, for each V G Gr<j (£ A , max ), 
the curve 

l3?w%V€ Gr do (£ A , max ) 
is real- analytic, and the infinitesimal generator of the group action K exp is the real 
part of a holomorphic vector field. 
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Proof. The proof is an elementary argument on Grassmannian varieties. Let Vo £ 
Grd (£ - A,max) and pick a basis <fr = [<pi, . . . ,4>d] of ^,max whose first do elements 
form a basis of Vo- Then n A , max K e c \ £ sends the basis <l> to the basis 4? • #t(C) 
whose j-th component is 

d 

5>**£(C); 

the matrix k(Q = [rt^(C)] depends holomorphically on £. Let <&i = . . . , 0d o ], 
*2 = [0d o +i, •• • If Z G M( rf - d °) Kdo (C) is a (d-d ) x do matrix with complex 
entries, then <&2 • Z is defined, the entries of $1 + $2 • are independent, and 

V(Z) = span(* 1 + * 2 • Z) C £ A , max 

defines an element of the Grassmannian Gr<i {£ a, max)- For a fixed basis the 
collection of elements V(Z) is a neighborhood {7 of Vo and Z 1— > V(Z) is the inverse 
of a holomorphic chart of Gr<2 (£ Aiinax ). Write the dx d matrix k(() in block form, 

_ r«Ko i^(o' 

with rti(C) £ M doX<io (C). With this notation, 7r A . max K e c | £ maps the components 
of $1 + $2 • ^ to the components of 

*! • («1(0 +"a(0^) +*a • («?(C) +«i(C)^)- 
If Z belongs to a bounded set in M( d ~ d °' xd °(C) then for £ small enough the matrix 
Ki(C) + ^(C)"^ * s mve rtible, since ft(0) = I, and we get from 

{*! + * 2 • («?(0 + «i(C)^)(«i(0 + 4(0^} • (k\(0+4(0z) 

that K e c maps the point in U of coordinates Z to the point in U of coordinates 
(is? (C) +kK()Z) (k{(() + kK() Z) . The latter is a holomorphic function of ( and 
Z. □ 

If V € £> A , then 2? = 7TA,max^ © ^A.tnin- Therefore 

for real £. For ( S C, define 

K eC X> = (7T A P)© 

The K e5 : Gr rfo (£ 

a, max) — > Gr^ (^A,max) with £ £ IR form a one-parameter group 
of biholomorphisms. Let 7~ A be the infinitesimal generator. The points where T A 
vanishes are the fixed points of K e s. The vector field 7a is the real part of a 
holomorphic vector field T h (a holomorphic section of T 1,0 2) A ). Since T A vanishes 
at a point if and only if 7^ vanishes at that point, we have that the set of fixed 
points of K e ( in each Gr^ (£ Amax ) is an analytic variety. 

Corollary 7.8. The set of K-invariant domains in 2) A is an analytic variety. 

Thus the set of K-invariant domains is a small set. 

Remark 7.9. By Lemma 5.12 of @|, a subspace of £ AjlnM is K-invariant if and only 
if it is a direct sum of subspaces £j C £ a AA/^), each of which is itself K-invariant. 
The set of K-invariant subspaces of £ a . (A A ) of a given dimension needs not be a 
discrete subset of the corresponding Grassmannian. 
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Again as in Sectional let 

K Ai x = kcr(A AiCmax - A), A £ bg-resA A . 

The proof of Proposition 15.81 gives that the /C Aj a are the fibers of a Hermitian 
holomorphic vector bundle 

/C A ->bg-resA A (7.10) 
over bg-res^4 A ; the rank of /C a |a q is the number d! al which may change with a. 

Lemma 7.11. Let A £ bg-resA A . The map K e sends /C a ,a to /C A , e ™A7 and so gives 
a vector bundle morphism AC A — > JC A . 

Proof. Writing (|7.1|l in the form 

A A - A = £- m K-V A - g m \)n e for every g > 0, (7.12) 

and letting each member of this identity act on 4> £ /C a ,a, we see that K g <p £ 

Lemma 15.101 has a word by word translation to the situation at hand and if 
V £ <S A ,a! then 

A £ res j4 a .d PI A a <=>> /C A , A H V = 0. (7.13) 

For such A, 

.max- 

(7.14) 

Let 

,in ax (A) 

Then 

o 

A Q 3 A > A^A.max(A) £ Gr^ (£ A ,max) 

is holomorphic. 

Suppose that Ao £ A Q and let T = {rAo : r > 0} be the ray through Ao- In view of 
Lemma lV.llI the set spec A At -pC\T will not contain points A with | A| large if and only 
if k,qK, a \ ("I T> = for g large. With the notation introduced in Dcfinition l5.22l (of 
course with £ max replaced by £ A,max) ; this will happen if and only if /e e /C Ajmax (Ao) ^ 
QJ^ A max u for large g. Since QJ^a max x> C Gr^/ A ,max) is of complex codimension 
1 and £) i ^ K e AC Ajmax (Ao) is a real curve, these curves generically do not intersect 
QJ 7rAmax D. However, it can happen that K /C A .max(Ao) £ 5J?r A max r> for all g, for 
instance if /Ca,a contains a nontrivial K-invariant subspace. It can also happen 
that /c e /C A ,max(Ao) £ 2Jtt a max x> infinitely often. For example, suppose that £ Aimax 
is two-dimensional and that the infinitesimal generator of the action K e has two 
distinct eigenvalues io~± and icr-i with 3tri = S(72- Let u±, ui be eigenvectors for 
these eigenvalues. If a\U\ + 0,2^2 is a basis element for 7r A!max 2? and /C Aimax (Ao) is 
spanned by the same vector, then /c e /C A , max (Ao) is spanned by a\g %ai u\ + a^g^^u^ 
and /c e A: A , max (Ao) (~l 7r A , max T> ^ whenever g = ^/(St^-st^) with k g z ^ 

We will show that the o spaces /C a ,a, A £ A Q , can be obtained directly from a 
single space JC A> x , Ao £ A Q via the action of k and -B A , m in(A), the left inverse of 
^A,r> mi „ — A with kernel equal to the orthogonal of 7^ a ,a = r g(^A,z> mln — A). The 
family -B A ,min(A) defends smoothly on A £ bg-res^4 A , cf. Sectional 

Fix some sector A Q and for the sake of simplicity let Ao £ A Q lie in the axis of 
symmetry T a of A Q . So 

A a = {A : |arg(A/A )| < 6 a } 
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where arg is the principal branch of the argument function on C\M_ . Let log be 
the principal branch of the logarithm on the same set. Then 

^Pmax(A)</> = 7rA,maxK e log(A/^ o )/m7TA,max0 

is well defined for <p G /C a ,a and is holomorphic in A for A ^ — T a . Thus we have a 
map 

^Pmax(A) ! /Ca,A > ^A.max 

depending holomorphically on A for A ^ — L Q . In general, if ^ e /C a ,a, then 

(A A - A)7r A ,min^ = ~{A A - A)7r A ,max0- 

Thus the right hand side belongs to the range 1Z A .\ of A A ,D min — A, and 

TTA.min^ = — S A ,min ( A) (A A — X)n A , max (j) 

Conversely, if u G £ A ,max and (A A — \)u G 7£ a ,a, then 

U - -B A ,min(A)(A A - X)U G /C A ,A- 

Define 

*Pmin(A) : 1C A .\ ~~ * f A,min, A G A Q 

by 

< Pmin(A)0 - -BA, m in(A)(A A - A)<P max (A)0, G /C A ,A - 

Let also 

*P(A) = *P max (A) + ^min(A) : ACa,A -» 2?A,max (7.15) 

The operators £>A,min(A) depend smoothly, but not holomorphically, on A (unless 
ind(yl A ,x) min — A) = for A G A Q ). So it is not obvious that ^Pmin(A) depends 
holomorphically on A. 

Proposition 7.16. The map <p m in(A) : /C a ,a — > I>A,min depends holomorphically 
on A G A Q , and 

<P(A)</> G /C a ,a /or A G A Q and <j> G /Ca,A - (7.17) 

Proof. Since Ao G bg-resA A , there is P G A , Q such that Ao G ycsA a .t>, so 
res AA,r>nA Q ^ 0. Let then S A ,i>(A) denote the resolvent of A A ,r> o on res A Ai j>f]A a . 
In particular Ba,x>(A) depends holomorphically on A G res A A ,r>nA Q . Let 4> G /Ca,a 
and define 

^Pmin,X>(A)</> = -7T A:m i n -B A ,I7(A)(AA - A)«P max (A)0 

o 

for A G rcs^A,© H A Q . Thus *p m i n ,X)(A) is holomorphic on the set where we defined 
it. Note that 7rA, m i n -BA,:D(A) is a holomorphic left inverse for A A ,r> min — A when 
A G res A A .x> H A a . 

If G /Ca,a an( i Q G ^+ then K e ^> G /C Aie m Ao and 

5Pmax(e m ^o)^ = 7TA,maxK e 0- 

Thus if £» m A G rcs^4 A ,x> then 

7rA,minK e = — ^ A ,ramB A ,v (f? m Ao) (A A - £> m Ao)7r A ,maxK e ^ 

= -7TA, m inS A ,I,(g m Ao)(^ A - e m A O ) < P m ax(e m Ao)0. 

Consequently, 

^max(£ m Ao)4> + ^min,X.(^ m A )(A = K e G /C A , e ", Ao . 

This implies that the equation 

(A A - A)R} max (A)4> + <p miniI7 (A)0] = 
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is satisfied when A 6 T a n resA A ,i5. By unique continuation, it is satisfied for any 
A G A a n res .4 A , -D- Thus 

^max(A)^ + WminAW G ^a,a if A € res A A , V H A Q . (7.18) 

For such A we therefore have 

(A A - A)<p max (A)<£ = — (j4 a - A)«p min , 23 (A)0 

so 

5Pmln,7>(A)0 = -B A ,mln(A)(i4 A - A)<P max (A)</> (7.19) 

that is, 

5Pmin,l?(A)0 = q3mxn(A)^. (7.20) 

Replacing this in (|7.18|) we see that formula (|7.17|) holds where ^Pmin,x>(A)0 is 
defined. 

Since the left hand side of 1)7. 2U|) is holomorphic where defined, so is the right 
hand side. Since the right hand side is continuous on A Q , the singularities of the 
left hand side, i.e. the elements of the discrete set spec Aa,t> H A a , are removable. 
Thus ?Pmin(A)(/) is holomorphic for A G A Q and by continuity l|7.17|l holds. □ 

The sets 

o 

£a = {^A,max(A) : A G A Q } C G^d' a (£ A ,max) 

play an important role, particularly their intersection with the varieties 03-^ max r>, 
V G ©a, «• These sets are invariant under the action of K e a for £ real. If V G 
Gr c j (£ - A,max), then C 3 ( ^ n e cV G Gr<j {£ A>ma x) is a holomorphic map, cf. Propo- 
sition l777l The generator of the one-parameter group (£, V) i— > K e zV, the vector field 
T A , is the real part of a holomorphic vector field T A , cf . the paragraph following the 
proof of Proposition l7.7l which at V is the image of the Cauchy-Riemann vector field 
at C = 0, t?f |o, under the differential of the map £ i— > K e cV. If V is not /c-invariant, 
i.e., 7a 7^ at V, then also the imaginary part of T A is different from at V; thus 
C i— > K e c V is a local embedding near £ = if 7a ^ at V. As a consequence we get 
that the real and imaginary parts of T' A commute at the noninvariant points. Since 
the set of invariant points is closed with empty interior, the real and imaginary parts 
of T A commute everywhere. We can view the images of the maps C 3 ( ^ K e c V 
as a point (if V is invariant) or as an integral manifold of the involutive Frobenius 
distribution generated by K7^, 07^ on Grd (£ A,max)\{V G Grd : V is K-invariant}. 

Theorem 7.21. The set C a is contained in one orbit ofT A . 

In fact, the set C a is identical to the set 

o 

.max ^a,a : A G A a }, 

a subset of the orbit of T A containing 7r A .max^A,Ao • Thus, if diniR Gr^ (£ A)ma x) > 2, 
then C a is in principle a small set (nevertheless it could be dense). 

The following lemma completes our description of the vector bundle /C A intro- 
duced in (ffTTDf) . 

Lemma 7.22. If <f> € IC A .\ a , then 



(7.23) 
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Proof. Write (A/A ) 1/m = e [ log (l A / Ao l) +larg ( A / Ao )l/"\ A £ -T a . For real g and 
A ^ — r a we have 

7I "A,max^e7TA,max'i'(A/Ao) 1 / m7I 'A,max = 7 '"A,max^(g»™A/Ao) 1 / m7 ''A,max 

o 

Thus 7r A , max «; e <p max (A)0 = Cp ma x(£> m A)</>. But if A G A a , then k b <P(A)^ 6 fc A , e m A 
and ^p m i n (gi m A)(/) is the unique element of P A)m i n such that 

<Pmax(e m A)0 + <P min (f/"A)0 £ AC A ,^A 

so we have 

This is □ 

Suppose £ /Ca,a - If <?K^) = ?KA)0 vanishes at some Ai, then 0(A) vanishes 
along the ray through Ai. Therefore it vanishes identically, since 4>{X) is holomor- 
phic. Thus, if we pick a basis {(f>j} of /C A) a 0) then the sections ^(X)4>j form a frame 
over A a for the bundle /C A . 

8. Resolvents for the model operator 

We now turn our attention to determining the existence of sectors of minimal 
growth for extensions of A A . 

If V G ©a, a, we write -B A ,x>(A) for the inverse of A A ,x> — A, A G resA A ,x>. If 
A G C\0, then A = A/|A|. By a closed sector we shall mean a set of the form 

A = {z G C : z = re 19 for r > 0, 9 G K, |0 - O | < a}. 

If R > and A is a closed sector, then A^ = {A G A : |A| > R}. Let P G <5 A , a . Let 
A be a closed sector with A\0 C A a . Then A is called a sector of minimal growth 
for A A ,x> if there is R > such that A Al x> — A is invertible if A G A#, and either of 
the equivalent estimates 

ll 5 A,r>(A)||^( :z .- m /2 i 2 ) <C/\X\, \\B AtV (A) \\^( x -m/2 L 2 )T ) AiimBt ) < C (8.1) 

holds for some C > when A G A^. 

The following lemma is immediate, in view of (|7.1() and the fact that K g is an 
isometry on x" m / 2 ig(F A ; E). 

Lemma 8.2. If T> G ©a. a, i^en resA AK -i 2 - ) = g~ m resA A ,x>. If res A Ay x> 7^ 0, 
B a, k ^p( A ) = ^ K s X B A ,v{Q m X)n e , 9 > 0. (8.3) 

o 

Thus, if the closed sector A, A\0 G A a: is a sector of minimal growth for A Ay x>, 
then A is cl sector of minimal growth for A^ 

In fact, if the first estimate in (|8.1|l holds when A G A^, then 

II- B a, k - 1 -d( a )II^?(x-'»/ 2 l2) < C/\X\, A G A R/gm 

with the same constant C . 

The simplest domains are those that are k- invariant: 

o 

Proposition 8.4. Suppose T> G ©a, a is n-invariant. Then either A a nresA A .u = 
0, or A a C res A/\ t z>- In the latter case the resolvent -Ba,d(A) of Aa,x> satisfies 

\\B^ v (\)\\^ m/ , Ll) <C/\\\ (8.5) 

o 

for some C > when A G A\0 ? A a closed sector with A\0 C A a . 



38 JUAN B. GIL, THOMAS KRAINER, AND GERARDO A. MENDOZA 

Proof. Suppose that Ao € A Q n spec j4 a ,x>. The homogeneity property (|T. 1|) and 
the assumption that V is K-invariant give that \/g m G specA^.-p for every g > 0. 
Thus spec^4 A .p (~l A Q is not discrete. On the other hand, if T> G G5a !Q ,\9Jq,, cf. 
Proposition l7.5l then specA Ai x>nA Q is a discrete closed subset of A Q . In particular, 
for every ray 

r = {z G C : z = re Wa for r > 0} (8.6) 

o 

contained in A a , T n specA A! £> is o closed and discrete. Thus, if T> is re-invariant, 
then A Q (~l specA A .D 7^ implies A Q C spec A A ^>- 

Suppose A is a closed sector with A\0 C resA Ai p. Since T> is /{-invariant, (|8.3|) 
reads 

Ba,p(A) = ^k^B^^X)^. 
Setting g = |A| _1 / m gives 

#A,X>(A) = |A| -1 K| A |i/ m 5 Ai D(A)K^j 1/m . 

For A G A (|A| = 1) we have a uniform estimate for \\B At -p(X)\\jf^ x - m /2 L 2^, an d <|8.5|1 
follows immediately, since K e is an isometry on x~ m / 2 L^(y A ; □ 

If the domain T> G © A , Q is not K-invariant, the existence of a ray or sector of 
minimal growth for B Aj d(X) is more complicated: 

o 

Theorem 8.7. Let T> G C? AjQ , let A be a closed sector with A\0 C A a . Then A is 
a sector of minimal growth for A At -p if and only if there are C , R > such that 
Afl C resA Aj x> and 

ll^max^ -1 v \ £ ||.Sf(D A , max ) < C, A G A R . (8.8) 

If T> is k- invariant, then 

TTA.roaxI'r . k" 1 -Dp = lA.maxTT/C. s .15 L , 

/v " A ,X'' t | X |l/m i ^ lfc A > max A . A ' lt A ,max 

and the theorem reduces to the trivial situation of Proposition 

The proof of the theorem requires some preparation. Define i?A,max(A) for A G 
bg-resA A as the right inverse of 

A/\ — A : P A , max C x- m ^ 2 L 2 b (Y A ;E) -» X - m / 2 L 2 (Y A ; E) 

with range in IC A \. Thus -B Amax (A) has the virtue of being the right inverse of 
^4-A,max — A with the smallest operator norm. It depends smoothly on A G bg-res A A ; 
this is proved in the same way as the corresponding statement for -B max (A) in 
Section Recall that -B A . m in(A) is the left inverse of ^4 A ,-D min — A with kernel equal 
to the orthogonal of 7Z At \ = rg(A Aj p min — A). For A G res A A}T > let 

. in ax max 

be the projection on /Ca,a according to the decomposition 2? A , ma x = AC a ,a ffi T>, cf. 
(I7.14|l . Then the resolvent of A A ,x> is 

Ba,d(A) = S A>max (A) - (J - B Amin (X)(A A - A))tt Ka >x ,vB A , max (\), (8.9) 

cf. Ij5.17|l . We will take advantage of this formula by using the group action k. We 
begin with estimates for B A) min(A) and -B A , m ax(A). 
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Lemma 8.10. The operator -B A , m in(A) is n-homogeneous of degree -m, 

BA,min(A) - Q- m K e B h ^{\/Q m )K-\ (8.11) 

Therefore, if A is a closed sector with A\0 C bg-resA A , i/ien 

||i?A,min(A)||^ (:c -W2 L?) <C/|A| (8.12) 

for some C > w/iera A £ A\0. 

Proo/. Let B' Amin (X) = g~ m K e B A:Blin (\/ g" 1 )^ l . The operator B' Amin (X) maps 
into 2?A,min because the latter space is K-invariant. Using the K-homogeneity of A A 
one verifies that the operator B' A min (A) is a left inverse for A A m { n — A. Also because 
of the K-invariance of T> Anlin and the K-homogeneity of A A — A, 1Z\ = K g lZx/ e ™- 
The kernel of B' A min (A) is K g lZ^ gm . Since K e is an isometry on x~ m t 2 L 2 {Y h \ E), 
Kg preserves the orthogonality of the decomposition lZ\/ e ™ © lZ^ gm . Hence, the 
kernel of B' A min {\) is orthogonal to K x . Thus B' A min (X) = 5 A ,mm(A), and (ggTTT|) 
holds. 

The estimate in (|8.12|l follows from setting g m = |A| in (|8.11() . □ 

The operator family -BA,max(A) is not K-homogeneous. Nevertheless its norm 
satisfies good estimates. 

Proposition 8.13. Let 7rjc A x : 2?A,max — ► 2?A,max be the orthogonal projection on 
/C/\,A- Regard the finite dimensional space 

K A ,x as a subspace of x~ m l 2 l|(F A ; E) 

and let 

p KA X : x- m ^ 2 L 2 b (Y A ; E) ^ x- m ^ 2 L 2 b (Y A - E) 
be the orthogonal projection on JC Aj \. Then 

i?A,max(A) = |A|- 1 K|A|1/m (/ - l^L pK ; A _ x )5A, max (A) K -J 1/m . (8.14) 

Therefore, if A is a closed sector such that A\0 C bg-resA A) then 

\\B*,m a xW\\x {x - m />Ll) < C/|A| (8.15) 
/or some C > w/ien A 6 A\0. 

The proof will require: 
Lemma 8.16. For any A <G bg-resyl A and g > 0, 

1 + |A| 2 1 — g 2m 

«J 1 Tx A ,.»,« e = 1 + |gmA|2 f 2m ^,, + 1 + |^ A | 2 P^- (8-17) 

We will prove the lemma later. 

Proo/ of Provosition WTA Suppose / S x~ m / 2 L 2 (Y^; E) and let u = B Aniax (X)f. 
Then (A A — g m \)n e u = g m K e (A A — X)u = g m K e f, and consequently 

B A ,, ms , x (g m \)g m K e f = K g u - 7iX A fimA «; e u. 

This gives the formula 

Q m B A ^ m ^(g m \)K e f — ft e -BA,max(A)/ — 7itc a em A K e B A j„ ax ( A)/ 

which, in view of l|8.17|l and the fact that the range of -B A , ma x(A) is orthogonal to 
ACa.a, reduces to 

mm 1 - fi^™ 

Q m B Aimax (g m X}K e f = K e i? A ,max(A)/ - - — ^ m ^| 2 K g pK: A|A i3 A:max (A)/. 
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Thus 



l-Q 



2m 



i?A,max(g m A) = Q- m K e (l - j - ^ - P Ka , A ) B A , ma3c ( A)« 



.-1 



The formula (|8.14|) is obtained from this by replacing g m by |A| and A by A. The 
estimate (I8.15|) is evident given the formula Q8.14J1 , □ 

The operator 



B A,m ax ( x ) = \M lK |A|i/™B A!max (A)K |A | 1/m , A G bg-resA, 



is a K-homogeneous right inverse of A Aimax — A of degree — m that coincides with 
_B Aiinax (A) when |A| = 1. For any closed sector A with A\0 C bg-resA A there is C 
such that 

\\B h A , max (\)\\j? (x - m/ 2 Ll) < C/\X\, A G A\Q, 
and for any closed sector A as above and R > 0, 

||S Ajmax (A) - BA,maxW\\&(x- m /*Ll) < C /\M 

for A G Ar. So in some estimates below, it makes little difference whether the 
correction term involving Pac a x is present or not. However, we will keep on using 
i?A,max(A) instead of E\ max (A), as the former family is in some sense more natural 
than the latter. 

Proof of Lemma \8.1b\ Let <j>±, . . . , 4>d' a be an v4 A -orthonormal basis of /C a .a- Then 

Sjk = {<f>j,4>k)A A = (1+ |A| 2 )(^-,0fe). 

In particular, the a/1 + |A| 2 ^j <E /C a ,a are orthonormal in x~ rn l 2 L\(Y^\ E). On the 
other hand, using that n Q is an isometry on x~ m / 2 L 2 (Y A ; E), 

{K e <j>j,K e <l> k ) A ^ = p 2m Oj,</>fc)A A + (1 - £> 2m )Oj,0fc) 



f n 2m , l + |g m A| 2 



Thus the + |A| 2 )/(1 + \Q m X\ 2 )n e 4>j G K,/\,Q m \ are -A A -orthonormal, and if it G 
/Ca.a, then 

1 + |A| 2 \- , 
' r A| " ^ [g 2m (u, ^-)a a + (1 - g 2m )(«, fc)]/C B & 



1 + |g m A| 2 



3 

1 + IAI 2 



1 + |p m A| 2 

1+IAI 2 1 — n 2m 

I 1+|A| 2 2m l-Q 2m v 



l + |e m A| 2C "'" A ' A " ' l + |g m A| 21 
This gives the formula in the statement of the lemma. □ 
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Note that if u € Da, max, then 

IIPjCa.^11 < ||«|| < NU*, \\P>c^u\\a a < Vl + |A| 2 |HU A . (8.18) 
Lemma 8.19. Let A be some closed sector, let R > 0, and let 

P(A) : x- m / 2 L 2 b {Y A ;E) ^V A , max 
be a family of operators defined for A S Ar. Then 

\\P(m^( x -m,2 Ll) <C/\X\ and \\P(\)\\jz {x - m/2Ll v A ^<C (8.20) 
hold for some C > and all A £ Ar if and only if 

\\^ /m PW\\^( x -^Llv^ x ) < C/\X\ (8.21) 
holds for some C > and all A £ Ar. 

Proof. Using that A A n^ 1/m P(X) = |A| _1 K|^| 1/ , m A A P(X), and that «j^7,y m is an 
isometry in x~ m l 2 L\{Y A \ E), we obtain 

ll«ji[iM-P(A)/||L = \\A A K- x ] 1/m P(X)f\\ 2 + \\n- x ] 1/m P(X)f\\ 2 

= \X\- 2 \\K- x ] 1/m A A P(X)f\\ 2 + \\ K ; x ] 1/m P(X)f\\ 2 

= \X\- 2 \\A A P(X)f\\ 2 + \\P(X)f\\ 2 

if / e x~ m/2 Ll(Y A ;E). Thus (ESDI follows from ijOTjl . 

Assume now that (|5^T|) holds and let / £ 2r m / 2 L 2 (Y" A ; £)■ Then 

IITO/H = \\K-^ 1/m P(X)f\\ < \\K-^ /m P(X)f\\ AA 

gives the first estimate in (|8.2UII . To obtain the second, write ||-P(A)/||^ as 

II j 4a-P(A)/|| 2 + ||P(A)/|| 2 = ||^ A ; i/ra A A P(A)/|| 2 + \\^ x \ 1/m P(X)f\\ 2 

and use the K-homogeneity of A A to conclude that 

ll*W||L = \X\ 2 \\A A K- x ] 1/m P(X)f\\ 2 + |] K -} 1/m P(A)/|| 2 

<(|A| 2 + l)|| K -} 1/m P(A)/||i A . 

The second estimate in (I8.20|) follows from this. □ 

Corollary 8.22. Let V £ <5 a iQ , let A be a closed sector. Then A is a sector of 
minimal growth for A A ^x> if and only if there are C , R > such that 

ll«ji|i/»-BA,o(A)|| JSf ( B -w>i ? ,o A ^„) <C/|A|, AeA fl . (8.23) 

Both -BA.min(A) and o -BA,max(A) satisfy l|8.2()(l . therefore H8.21(l for any closed 
sector A with A\0 C A Q . In the case of -B A ,min(A), the first of the estimates in 
(I8.20[) is H8.12f) . To prove the second we note that 

^A-BA,min(A) = n-JZ A x + AB A ,min(A) 

where tt-ji a a : x _m/2 L 2 (y A ; E) — » x~ m l 2 L 2 (Y A ; E) is the orthogonal projection 
on lZ At x- The norm of this operator is 1, and \\XB A _ m i n (X)\\^^ x ~ m /2 L 2- ) is bounded 
independently of A when A £ A and |A| is large. The argument for i?A,max(A) is 
analogous, using H8.15(l and the fact that this operator is a right inverse for A A — X. 
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Proof of Theorem \IFJ\ We will prove that (|8.8|l is equivalent to (|8.23|) . Recalling the 
formula (|8.9(l for £?a,x>(A) and that -BA,max(A) satisfies (|8.21|) . we see that Z?a,z>(A) 
satisfies <|8.23ll if and only if 

H K |a|i/"> (I ~ B A,mm(A)(4 - ^)) n K. A ,i,vB A , max (X)\\cf( x - m /2 L 2 VirL ^ < C/\X\ 

for A e A, |A| large. We have 



K 



-1 



,min 

(A)(A A - A))tt Ka A , Cj B A , max (A) 



A|i/" 

(-f - -B A , min (A)(yl A - X))K7 x , 1/m nK AiX ,T>K\x\i/mK7 x . 1/m B Aiia g X (X) 

Evidently /C a ,a H V = if and only if Kr x j 1 / m /C A ,A H K^j 1/m 2? = 0. By Lemma 17. Ill 
K~| 1/m AC A ,A = <*C A ^, and it is not hard to sec that 

K7 x ] 1/m ir K ^ XtV K lM i /m =TT K -1 v . 

I A j A 3 |A|l/m 

Using that / — B A min (X)(A A — A) and ir/c A A) r> both vanish on pA,min regardless of 
A and V, we arrive at the conclusion that B A ,i»(A) satisfies (I8.23|) if and only if the 
norm of 

,min 

(A)(A A -A)) (A) (8.24) 

A, A' | A |l/m I 

as an operator x~ m / 2 i^(F A ; E) — » P A , ma x is bounded by C/|A| for some C if A £ A, 
|A| large. By Lemma f8. 191 

ll K | A : fl/ m -BA,max(A)||^ f ( :I .- m /2 i 2 iI , A max ) < C/\X\ 

for A 6 A, |A| large. Evidently 

H-f - -B A ,min(A)(AA - A)||jf(x> A max ) 

is bounded independently of A, A G A\0. Thus if 18. 8|) holds, then the norm of the 
operator (|8.24|) is bounded by C/|A| for some C when A £ A, |A| large. 

Conversely, suppose that the norm of the operator l|8.24|l is bounded by C/\X\ 
for some C when A G A, |A| large. Composing with 7r A , m ax on the left we get that 
the norm of 

. 7fA,max^|^|i/ m -^A,max(A) 

as an operator x~ m t 2 L'l(Y ry ; E) — > £ AjmH satisfies the same estimate. Using the 
formula (|8.14|) for i?A,max(A) we get 

TTA.maxTr^ _ R -l pK| A | i /m i?A,max ( A) = 

1 - |A| 2 - l 

\X\ 1 TTA,m a KTT K ^ . xiK -^ i/m - D (l ~ ^ ~ Pk a ,X) B ^,^ W K \\\l/m- 

We dismiss the factor Kj^|i/ m at the end of the last formula, since this is an isometry 
on x~ m l 2 L\{Y^\ E). Since pjc^ , has range in KZ A x , 

■l-|A| 2 



A| ^A.max TT/C^.K-l P ( 1 + UI2 ) P^a.a B A,max(A) 



1 — |A| 2 

-max (A). 
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This operator x~ m / 2 ig(F A ; E) -> T> A , max evidently has norm 0(|A| -1 ) if A € A, 
A | — * oo (cf. I|8.18jl ). We conclude that if the norm of l|8.24(l is bounded as 
indicated, then the norm of 

5A,max(A) (8.25) 

A,A> | A |l/ m 

is bounded by a constant when A 6 A, |A| large. The operator A A — A on Pa, max 
satisfies \\A A — \\\%>(t> a m „,i-»/2L^) < 1- So composing the operator 18.25|l with 
A A — A on the right we get that the norm of 

^A.max^r . K - 1 T) \ ^AC * */ = ^A.max^r . ti ^A.max ^ A . max ^"aC A ; 

A , A ' | ^ 1 1 / rn 7 ' A,A' |^|l/m ' 7 

satisfies the same estimate. Since ||^A,max7ne A X ||.5f(-D A max ) < 1, and using that 
7r AC A x ,r> = 7r K A s,x>i"a, maxi we obtain that if A is a sector of minimal growth for 

A,X?i 



77, then 



||^"A,max - k" 1 , 15 ^A.max ||^f (£> A max ) 

a. A< | A] l/m 

is bounded for A £ A, |A| large. This completes the proof of the theorem. □ 

o 

Let /C AjIIlax (A) = 7r Aiinax A: A:A . Let V E <8 A , a , let A £ A Q be such that |A | = f , 
and let R > 0. The condition that 

g m \ Q E resA A ,x> for g > R (8.26) 

is equivalent to the statement that /C a , ™a o H 2? = for g > R, which in turn 
is equivalent to the condition that /C a ,a„ H kJ 1 !) = for g > R. Thus, since 
■^a,a H Kg 1 T> = if and only if 7r Ajmax /C A ,A H 7r A , max Kg 1 P = 0, the condition in 
(|8.2()|l is equivalent to the statement that the curve 7 defined by 

[R, 00) 3 g ^ -y(g) K g T> £ G?d£ (£ A, max) (8.27) 

does not intersect the variety %3ic A max (A ) introduced in Definition l5.22l fwith £ Ajmax 
in place of £ m ax)' With the proof of Lemma r5.2fl 7r A m „jr r is the 

' ^A-AgAg ^IfcA, max 

projection on /C A>max (Ao) according to the decomposition 

.max .max- 

Thus if there is a neighborhood -J7 of max (A Q ) m Gr^// (£ A ,max) sucn that 7(g) ^ U 
if p is sufficiently large, then Lemma 15. 251 gives that 

is bounded as g — > 00. Therefore the necessary condition of Theorem l8.7l is satisfied, 
and we get: 

o 

Theorem 8.28. Let Ao E bg-res^4 A belong to A a . Let V E & A . a and suppose that 
there is a neighborhood U E Gr<j» {£ A, raax ) o/9J ac a „ x (a ) smc/i thatTr Alinax K~ T> £ U 
for all sufficiently large g. Then there is a closed sector A containing Ao which is a 
sector of minimal growth for j4 a .jj. 
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9. Resolvents 

We will now prove the analogue of Theorem 18. 71 for A G x~ m Diff™(Af; E). 

Define A g = g~ m k~ 1 An e . Then A e is c-elliptic, since A is assumed to be c- 
elliptic, cf. Using that A B -A belongs to x - m+1 Diff^ l (M; E), 4, Proposition 

4.1(1)] gives the first formula in 

T^min(Ag) = T) m in{A) 7 D max (A g ) — K g 1 'D nlax (A) . 

The second is obtained using that n g preserves C§°(M;E) and x" m l 2 L\{M;E). We 
will write Vg maK instead of T> max (A g ), and T> mm instead of V m - m (A g ). Generally 
we prepend the symbol g to subindices of objects associated with A g originally 
associated with A. In particular, 

F — T>^- 

<--£,max — ^min 

with the orthogonal computed in X>g jmax using the inner product 

(u,v) Ae = (A e u, A g v) + (u,v) 

of P e ,max, and 7r e)max : X> e , max -> 2? e , ma x is the orthogonal projection on £ e: „ lax . It 
is not hard to verify that 

f w „ax = K- x [ker(AM + Q 2m ) n PmJ, (9.1) 

cf. Lemma f4. 51 
Using 

we see that 

bg-resA e = (T m bg-resA 

For A G be -res A g let tC g ^\ = ker(Ag -p max — A). Then fcg,x/e m = K e ^^A- If 2^ G ©, 
then Kg 1 !) G <5 e , and if A G resAp, then A/@ TO G res A K -i v - It is easy to verify 



Q- m K -\A- Q m X)K s =A s -\ (9.2) 



that X>g imax = K,g^\jgm. © k" 1 !? and that 



K e Wx.DKe = 7i"K: e , A/em ,k-'v ( 9 - 3 ) 

Let i3g jm in(A) = g m K~ 1 B m i n (Q m X)K g . This is a left inverse of Ag ; p min — A. The 
operator -Bg im i n (A) has range in X> m i n since this subspace is K-invariant and the 
range of B min (g m X) is P min . 

Theorem 9.4. Let D G (5 and fe£ A 6e a closed sector. Then A is a sector of 
minimal growth for Ax> if and only if there are positive constants C, R such that 
A R C res Ad, 

|[5 min (A) \\sf {x -m /2Ll) < C/\X\, \\B max (\)\\^ (x - m/ i LD < C/\X\, (9.5) 

and 

lk|A|i/™ m ax%; ixil/m ,,,«-; i/m c| £|A|1/m ma JI^ |A|1/m , max ) <^ *G A fl . (9.6) 

The proof requires a number of analogues of results obtained in the previous 
section. Their proofs parallel those in that section. 
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Lemma 9.7. Let A be some closed sector, let R > 0, and let 

P(\):x- m / 2 L 2 b (M;E)->V mllx 
be a family of operators defined for X G Ar. Then 

\\P(X)\\^ {x - m/ , Ll) <C/\X\ and \\P(X)\\s» {x - m ,2 L iv^) <C (9.8) 
hold for some C > and all X G if and only if 

\\^ /m nm^( X -^Li,v lMymxn j < c/\x\ (9.9) 

holds for some C > and all X £ Ar. 

Proof. Using that A\ x \i/ m n~ x ^ 1/m P(X) = \X\~ X n~^ 1/m AP(X), and that rej^j 1/m is an 
isometry in x~ m ^ 2 L 2 (M; E), we obtain 

II V; i/m P(A)/||i |A|i/m = \\A w/mK - x ] 1/m P(X)f\\ 2 + \\n- x ] 1/m P(X)f\\ 2 

= \X\- 2 \\ K - x ] 1/m A w/m P(X)f\\ 2 + ||^j 1/m P(A)/|| 2 

= |Ar 2 ||A |A|1/m P(A)/|| 2 + ||P(A)/|| 2 

if / G x- m / 2 Ll{M;E). Thus follows from 

Assume now that (JHSJ holds and let / G x" m/2 L 2 b {M; E). Then 

II^WII - ||«p A } 1/m P(A)/|| < || K -| 1/m P(A)/|U^ |1/m 

gives the first estimate in (|9.8|l . To obtain the second, write ||-P(A)/||^ as 

\\AP(X)f\\ 2 + \\P(X)f\\ 2 = \\ K - x ] 1/m AP(X)f\\ 2 + ||^ A ; i/m P(A)/|| 2 

and use the definition of A| A |i/ m to conclude that 

\\P(X)f\\ 2 A = |A| 2 ||A |A|1/mK p A | 1/m F(A)/|| 2 + ||^ A | 1/m F(A)/|| 2 

<(|A| 2 + i)|| K r A ; i/m p(A)/|| 2 

II | A | / 

The second estimate in (19 .8|) follows from this. □ 

Corollary 9.10. Let T> G 0, let A be a closed sector. Then A is a sector of 
minimal growth for Ad if and only if there are positive constants C , R such that 
An C res and 

\\^ x ) 1/m B v (X)\\x {x - m/2LltVwi/m ^j <C/\X\, X€A R . (9.11) 

Proof of Theorem \9.4\ Sufficiency of the condition. We will show that 1(9.5(1 and 
(19.6(1 imply (|9.11(l . Since i? m i n (A) and -B ma x(A) satisfy the estimate in ((9.5(> . and 
since these estimates imply for each of them the second estimate in ((9.8(1 , we obtain 
that n^ 1/m B m i n (X) and n^ 1/m B ms , x (X) both satisfy 1(9.9(1 . In particular, to prove 
((9.11(1 we only need to prove that for some C, 

ll«jJ/«(Bz>(A) -iWA))||^(*-w^ 1All/mmax ) < C/|A|, A g A R . 

Writing B- D (X) as in ((5.19(1 we get 

KjJ/m (-Bmax(A) - B V {X)) = /s-} 1/m (/ - B min (X)(A - A)) n Kx ,2,B maI (A). 

We rewrite the right hand side as 

(/ - 5 |A|i/™,min(A)(A|A|i/™ - A))«;j^| 1/m 7T/C A ,Z> «| \\ l/m «f^| 1/m -B max (A) . (9.12) 
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Using that I — -B| A |i/ mmin (A)(Aj A |i/ m — A) vanishes on 2? m in, the identity (|9.3(l . and 
that P m in C K7-} t / m T> we replace the factor K7 ) \t/m' n 'Kx,T>K\\\i/-m in (|9.12|) by 

^lAli/^maxTTr j.K -1 ,, X» "l A l 1/m - max ' 

By hypothesis the norms of these operators "D\x\i-/m tmBX ~~ * ^|A| 1 /' rrt ,max are uniformly 
bounded when A £ A^. It is easy to verify that the norm of 

I - S| A |i/ m min (A)(A| A |i/ m - A) : £>|A|i/™, m ax ^lAIVm.max 

is bounded independently of A, A e A/?. Finally, as already discussed, 

||K|^|i/ m -B max (A)||^ ?(:I ,- m /2 L 2 ^^ |i/m < C/|A| 

holds for some C > and all A £ A#. Altogether these estimates give l|9.11|l . Q 

To prove the necessity of the condition in Theorem 19 . 41 we will need two lemmas. 

Lemma 9.13. Suppose that T> £ and that the closed sector A is a sector of 
minimal growth for A-p ■ Then there are positive constants R and C such that 

||-B min (A)||^ (:I ,- m /2 L 2 ) < C/|A|, \\B max (X) \\&{x-™/i L l) < C /\M 

for A £ A R . 

This is a direct consequence of the formulas 

5min(A) = B v (\)ttk x , S max (A) = B V (X) - 7r Kx B2?(A), 

cf. (|5.13(l and l|5.15|l valid for A £ resAx>. 

Lemma 9.14. Letp Kg X : x~ m / 2 L 2 (M; E) -> x~ m l 2 L\(M\ E) be the orthogonal 
projection on lC g ^\ regarded as a subspace of x~ m / 2 L 2 (M]E). Then 

1 + |A| 2 1 — p 2m 

K~ 1 Tr K , m .K = 1 ' ,n Q 2m ^K J i Tl^PlC x- (9.15) 

g e e l + |p™A| 2 e - x l + |p m A| 2 e - x K ' 



Moreover, ||pK e , A ||^(x> e , max ) < \/l + |A| 2 . 

Proof. The proof of l|9.15(l parallels that of Lemma 18.161 Let (f>\ , . . . , <j>d' be an 
Ag-orthonormal basis of IC e .\ — K~ 1 lC g m\. Then 

Sjk = {<t>j,<f>k) Ag = (1 + |A| 2 )(0j,^fc). 



In particular, the yl + \\\ 2 (f>j £ 1C e ,\ are orthonormal in x~ m / 2 L 2 {M; E). On the 
other hand, using that n e is an isometry on x~ m l 2 L\(M\ E), 

1 4- I o m A 1 2 

(K B ^,K^ k ) A = Q 2m (h,M Ae + (1 - Q 2m ){^Ak) = ffr^ S jk . 

This gives an A-orthonormal basis of ICg^x, and if u £ /C eiA , then 
1 + |A| 2 ^ , , , 





2 



1 + |£» m A 

1+jAj 

1 + |£> m A| 2 

2 



J] [g 2m (uAj)A e + (i - e^Xu, 



1 + |A| 1 — Q 

Thus (|9.15|) follows. The estimate of the norm of p/c x is elementary. □ 
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Proof of Theorem \9.4\ Necessity of the condition. Suppose that A is a sector of 
minimal growth for A-p- By Lemma 19.131 ()9.5|) holds. In particular there are 
C, R such that the operator 

^ 1/m (B max (X) - B v {\)) = ^j 1/m (/ - B min (X){A - A))7r KA , I?J B max (A) 

as an element of Jz?(a;~ m / 2 L 2 , 2?| A |i/ mmax ) has norm bounded by C/\X\ if A G Ar. 
Composing with 7T| A |i/ mmax on the left, and using that K^| 1/m preserves X> m in, we 
conclude that 

7r |A|i/™, m a X K | A }i/r„(^ - B min (X)(A - A)) n Kx ^B mayi ( A) 

= 7r |A| 1 /«», m ax«j^|i/m 7I7C*,2?-B max (A) 

satisfies the same estimate. The operator 

(A - A)K| A |i /m = |A|K| A |i /m (A| A |i /m - A), 

as an element of Jzf(l?| A |i/ m max , x~ m ' 2 Ll), has norm bounded by 2|A|, A ^ 0. Thus 
the operator 

-i 



K\\\V™, I na. X K \\\i/rn, 7r K. x ,vB max (X)(A - A)/t| A |i/m 

= 1"|A| 1 /"»,max K |X|V"' n K x ,v{I ~ n lC\ ) K \ A) 1 ' m > 

as an element of J^f (£> | A |i/m !max ), has norm bounded by a constant independent of 
A 6 A/?. Since ttk x ,v^k x = ^K x , 

-i 2|A| 2 1-|A| 2 

K |A | 1/m 70C A ^/C A K| A | 1/m - 1 + | A | 2 ^ |A|1/m , + 1 + | A | 2 P'C |A| i/ m .x 

using (|9~15|l . Thus 

lk|A| 1 / m , max K[ A |i /m 7TK; A ,x)7rK; A K| A |i/ m ||^c D|A|1/m < C, A e Ar, 
for some C and consequently also 

l! 7r |A| 1 /™ :max K^ : fi/ m 7rK; A: -DK| A |i/™||^(X) |A|1/m ma j < C, X e A R , 
for some other C. Using l|9.3|) we conclude that in particular 

IK|A|V», m „7r x . |Aii/fB rx ^ 1/m v\ £ixil/m n JW(v wl/m max ) < C, A e A R , 
This completes the proof of the necessity of the condition. □ 
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